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THE EFFECTS OF UTILIZING SELECTED COMMUNITY 
RESOURCES IN NINTH-GRADE AND TENTH-GRADE 
HOMEMAKING CLASSES’ 


Epna D. MESHKE 
Butler University 


The present investigation was undertaken 
to discover: (1) whether, within the structure 
of the typical secondary-school curriculum 
and schedules, community resources could be 
used in connection with home economics in- 
struction; (2) the effectiveness of instruction 
when it included direct contacts in the com- 
munty and when it was limited to classroom 
activities; and (3) whether contacts with 
either type of experimental procedure in- 
creased pupil achievement over that which 
resulted from instruction when such contacts 
were lacking. 


ScoPE OF THE PROBLEM 


The study began in February, 1941, and 
extended over a period of approximately one 
year. It was carried on in ten communities 
and included fourteen ninth-grade classes 
with an enrollment of 268 girls, and thirteen 
tenth-grade classes with an enrollment of 
220 girls. Experimental procedures were in- 
troduced into seven schools, and the other 
four were used as control schools. 

Communities were selected that had rela- 
tively similar types of store and electrical 
services and in which home economics was 
offered at both the ninth-grade and the 
tenth-grade levels and in departments with 
reasonably adequate space and equipment. 

Eight ninth-grade classes studied “Food 
Selection and Purchase” for twelve weeks as 
a part of the regular food study unit ordi- 
narily taught during the fall semester. These 
classes were taught by five different teachers; 
four of them were taught with store contacts 
and four with instruction limited to the 
classroom. 

Eight tenth-grade classes studied the 
“Selection and Care of Electrical Equipment” 


1 Abstrac completed at the 
University the direction of 
Clara M. 


t of a doctorate dissertation 
of Minnesota in 1942, under 
Brown. 


for four consecutive weeks as a part of the 
house furnishing and equipment unit ordi- 
narily included in that grade. These classes 
were taught by five different teachers; four 
of them were taught with store contacts and 
four with instruction limited to the classroom.. 

In addition, ten control classes were used: 
five in the ninth grade and five in the tenth 
grade. 


PROCEDURE 


The tentative selection of the communities 
was made in March, 1941, after an analysis 
of questionnaire returns and following a visit 
to the high schools. 

Instructional materials and evaluation de- 
vices were prepared during the summer and 
early fall; the schools were revisited and a 
half-day conference was held with the par- 
ticipating teachers during September; and 
the experimental procedures were inaugurated 
in most schools early in October. The last 
data were collected in March, 1942. 

The final decision as to which schools 
would be used for experimental and which 
for control classes was determined by the 
number of ninth- and tenth-grade classes in 
the school and its accessibility to Minne- 
apolis and to other communities which would 
be used. The latter criterion was important 
because, during the study, the author planned 
to make several visits to the experimental 
schools and only one visit to each control 
school. 


Instructional Procedures Used With 
Different Groups 


The ninth-grade and the _ tenth-grade 
classes were divided into three groups: those 
classes in which pupils had direct contact 
with the stores and referred to hereafter as 
the “store” group; those classes in which 
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pupils had contact only with classroom mate- 
rials and referred to as the “classroom” 
group; and those in which no experimental 
procedures were used and referred to as the 
“control” group. 


“Store classes” took one exploratory excur- 
sion with the teacher at the beginning of the 
unit to become acquainted with the location 
and general characteristics of the local stores; 
and this was followed by indivdual and group 
trips taken by pupils during class time. In 
the ninth grade, each pupil had two opportu- 
nities to purchase supplies for a particular 
foods lesson or for use in the department for 
other classes. In the tenth grade, six field 
trips were taken during the four-week unit 
to investigate the six pieces of electrical 
equipment studied. 


“Classroom classes” used a variety of 
descriptive and pictorial materials to supple- 
ment class discussions. In the ninth grade, 
the teachers supplied the classes with weekly 
sales sheets from the local grocery stores and 
with food advertisements from newspapers; 
these furnished the basic information on 
prices, qualities, sizes, and the foods that 
were in season. In the tenth grade, the 
teachers collected and made available to the 
pupils illustrated booklets, pamphets, and 
other supplementary descriptive materials 
dealing with electrical equipment. 

“Control classes” were taught in any way 
that the teacher desired. No explanation was 
made of the plans developed for use in either 
of the experimental groups, and the teachers 
were permitted to teach the units for. the 
length of time they considered desirable for 
their pupils. The only requirements made of 
the teachers were that they teach units in 
food selection and purchase, and in the selec- 
tion and care of electrical equipment, and that 
they administer the necessary tests which the 
investigator supplied before instruction and 
at the close of the units. 


Development of Instructional Materials 
and Techniques of Evaluation © 


There seemed to be little need for develop- 
ing any special instructional materials for 
the ninth-grade foods unit, because there 
were texts, references, and other materials 
easily available; but a very different situation 
existed in the case of the tenth-grade unit on 
electrical equipment. Therefore, the mate- 
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rials developed for each grade are discussed 
separately. 

Ninth Grade.—Tentative objectives for in- 
struction in food selection and purchase 
were formulated on the basis of previous 
knowledge of ninth-grade home economics 
work. It was known that pupils were fre- 
quently sent to the stores to buy groceries for 
home use, and it was assumed that they had 
certain attitudes and encountered certain 
problems in connection with their job as 
buyers, such as how much to buy, where to 
buy, how much to pay, what to do if the 
price was too high, how to judge quality, and 
how to do the buying in the quickest way and 
with the greatest satisfaction. 

The pencil-and-paper test covered such 
problems as those cited. The test items were 
constructed after a study of high school texts, 
reference books, food advertisements, and 
weekly sales sheets from the stores; and 
visits to grocery stores to examine labels and 
to discover features that might attract the 
average shopper. 

Check lists and rating devices were devel- 
oped for the pupils to record their behavior 
when buying, the decisions they would make 
under certain described conditions, and their 
judgment concerning groceries bought by 
someone else. A list of general suggestions for 
the food buyer, and three short self-admin- 
istering tests, were formulated for use as 
study guides for both store and classroom 
classes. 

Tenth Grade.—Pupil goals for the study of 
electrical equipment were believed to be less 
tangible and personal than were those for the 
unit on foods. However, it was assumed that 
those who had not studied a body of content 
dealing specifically with electrical equipment 
were likely to be interested in learning how 
much it costs to use electrical equipment, 
how a “good buy” can be recognized, what a 
guarantee really means, how long a piece of 
equipment will last, and other information 
of a similar practical nature. 

A survey of available library materials 
dealing with some aspect of electrical equip- 
ment and of the illustrative and descriptive 
booklets from manufacturers led to the con- 
clusion that a great deal of material was 
available, ranging from fragmentary technical 
discussions to broad generalities, and an in- 
spection of many pieces of equipment in the § 
stores showed that much information could be 
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secured from dealers and from a careful ex- 
amination of merchandise. However, it 
seemed reasonable to conclude that high 
school teachers would not have the time, the 
patience, or the desire to canvass all of these 
sources to secure instructional materials for 
a short unit. Also, it seemed desirable that 
the pupils in both the store and the classroom 
groups in the tenth grade should have access 
to at least some of the same instructional 
materials. Consequently, prior to the inaugu- 
ration of the experiment, a 44-page booklet 
was prepared covering the basic facts pertain- 
ing to the six pieces of electrical equipment 
that were most frequently available in 
homes,? according to a recent survey. Char- 
acteristic features of each piece of equipment 
were described for low, medium, and high 
price levels; and definite suggestions were 
presented to serve as guides for the selection 
and care of the equipment. 

To establish a basis for uniformity of 
emphasis in the experimental classes, it 
seemed desirable to provide guides for dis- 
cussing the factual material and its applica- 
tions. For this purpose, the home situations 
of three families were described, and an ex- 
planation. made of their needs for new equip- 
ment and of the problems involved before a 
purchase could be made. 

The pencil-and-paper test consisted of 
judgment questions based upon the factual 
content of the booklet and upon the state- 
ments found in advertisements of electrical 
equipment. 


Cooperative Development of Experi- 
mental Procedures 


Early in September, 1941, seven schools, 
selected for the experimental situations, were 
re-visited and a joint planning conference 
was proposed to the home economics teachers. 

The teachers came to the university 
campus one Saturday in September, at their 
own expense, for a half-day meeting to dis- 
cuss goals, content, source materials, pupil 
activities, and possibilities for checking out- 
comes. The investigator announced no pre- 
determined plans for the experimental proce- 
dures at this conference. Instead, she worked 
out with the teachers the pupil goals for the 
units, in terms of the problems that their 
pupils were concerned with when selecting 
food, and in the light of the questions which 


*Edna Meshke, Selection and Care of Electrical Equip- 
ment. Minneapolis: Burgess Publishing Company, 1941. 
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they believed their pupils would ask about 
electrical equipment. In addition, the cooper- 
ating teachers discussed the content of each 
unit and listed the teaching procedures that 
they believed would be effective in attaining 
the goals set up and would be appropriate to 
the subject matter of the particular unit; and 
a careful analysis was made of the differences 
between the two experimental procedures in 
terms of materials of instruction, pupil activ- 
ities, and means of evaluation. 


Descriptions were presented of the instruc- 
tional materials in the process of construction, 
and the teachers were told that such mate- 
rials would be made available to them and to 
their pupils when each unit was begun in 
their schools. 


It was announced that the experimental 
procedure followed in each class would be 
determined by chance and that on the day of 
the first pre-test the specific assignment would 
be made. Teachers indicated tentatively when 
they would be ready to begin the experimental 
units in each grade. The exact dates for the 
administration of pre-tests were determined 
later by correspondence. 


Both “store” and “classroom” procedures 
were used in each school where ninth- and 
tenth-grade classes were taught, and the 
assignment of procedures to specific classes 
was made without definite knowledge about 
the pupils or of the teacher’s effectiveness, 
but chiefly from the standpoint of securing an 
approximately equal number of classes in 
which each experimental procedure would be 
followed. 


Investigator’s Contacts With Schools 


The investigator administered the pretest 
for each unit in each experimental school 
when the teacher indicated that she was 
ready to introduce the experimental proce- 
dures. Assistance was given to enable the 
teachers to follow the specified procedures in 
connection with regular school routines and 
to interpret the use of the instructional mate- 
rials and check lists. One or more visits were 
made to each experimental school during the 
progress of each unit, and again at the close 
of the experimental period, in order to ad- 
minister the re-test and to collect all pupil 
records. 


Visits were made to the control schools for 
the purpose of administering the pretests in 
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each grade, but the teachers in these schools 
administered the tests themselves when the 
work had been completed. 


ANALYSIS OF DATA 


The following data were collected: the pre- 
test score, the retest score (the same form of 
the pencil-and-paper test was used for both 
the pretest and the retest in each grade), 
the IQ based on the Otis test,* and the socio- 
economic status based upon the father’s occu- 
pation. It was found that the father’s occu- 
pation had relatively little influence upon the 
daughter’s retest score, since the correlation 
was negligible; hence, no consideration was 
given to occupational status in the statistical 
analysis of the retest scores. 

The coefficient of reliability of the pencil- 
and-paper tests, administered as retests, was 
.go for the ninth-grade test and .87 for the 
tenth-grade test. The split-score method was 
used to compute the reliability of the tests, 
and the resulting coefficients were stepped up 
by application of the Spearman—Brown 
formula. 

The check-list ratings and the pupil com- 
ments that were collected as supplementary 
evidence were not subjected to rigorous sta- 
tistical analysis, but the test data were care- 
fully analyzed. The statistical treatment of 
the test data involved primarily two tech- 
niques, namely, the analysis of variance and 
the analysis of covariance. 

The analysis of variance was used to dis- 
cover whether the several classes were suffi- 
ciently homogeneous with respect to their 
means to be considered as_ representative 
samples from the same population. 

The technique used to test for homogeneity 
of means makes it possible to isolate and 
compare the variations derived from two 
sources: within each class and among the 
classes. The formulas used in computing 
these estimates of variation are based upon 
the principle of least squares which, when 
developed algebraically, shows that the mean 
is the value from which each individual score 
deviates the least when the variation is 
measured by squaring the deviations. 

The estimates of variation both within 
classes and among classes, expressed as mean 
squares, are quotients in which the sum of 
the squares represents the numerator and the 
degrees of freedom or number of independent 


* Quick Scoring; Form Beta A_ for the ninth grade and 
Form Gamma. C for the tenth grade. 
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comparisons that it is possible to make rep- 
resents the denominator of the value. 

The F-ratios, obtained by comparing the 
mean square @mong a number of classes with 
the mean square within these classes, were 
checked with tabeled values of F at the .o5 
level and at the .or level for the appropriate 
degrees of freedom, to discover whether the 
differences were great enough to be significant 
or whether they were likely to be merely 
chance occurrences. 

The .o1r value of F was selected as the 
acceptable level of significance in the present 
study, and all observed F-values greater than 
the one percent point were considered sta- 
tistically significant or, in other words, indi- 
cated that the groups being compared were 
not homogeneous. 

In order that the results obtained in the 
present study might have predictive value, it 
was necessary to discover the “consistency in 
outcomes” among a number of classes in 
which a specified teaching procedure had 
been used, and to base conclusions regarding 
the effectiveness of the procedure upon the 
results observed from as many replications 
as possible. Therefore, the retest scores were 
used as the criterion for determining whether 
the classes were sufficiently homogeneous to 
be considered as samples representative of the 
same population. If homogeneity of retest 
scores was demonstrated, heterogeneity of 
means of the IQ’s and initial scores were not 
considered in grouping classes, because ad- 
justments for differences in initial measures 
were to be made by covariance in all analyses 
in which groups of classes that were homoge- 
neous on retest scores were treated as a single 
sample. 

Analysis of covariance involves the analy- 
sis of the sum of cross-products of deviations 
into component parts in the same way as the 
sum of squares of deviations is analyzed into 
component parts when only one variable is 
considered. The actual adjustment of the re- 
test scores in the present study was made in 
terms of the multiple regression equation be- 
tween the retest scores and the IQ’s and the 
initial test scores. 

It was necessary to test the basic assump- 
tions underlying the use of the analysis of 
variance (normality of distribution and 
homogeneity of variance) and the analysis of 
covariance (homogeneity of regression and 
homogeneity of residual variance) before one 
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TABLE I 
MEANS OF IQ, PRETEST SCORES, AND RETEST SCORES FOR THE NINTH-GRADE CLASSES 


Schools 
oo roup 


was justified in grouping classes shown to be 
§ homogeneous with respect to means of the 
retest scores or the adjusted retest scores. 

Since the F-test permits fairly wide depar- 
ture from normality and since inspection of 
the data gave no indication of such depar- 
tures, it was deemed unnecessary to test the 
assumption of normal distribution. However, 
the other basic assumptions were tested and 
satisfactorily demonstrated in each situation 
where the analysis of variance and the anal- 
ysis of covariance were used in the present 
study. 

In each group of ninth-grade classes (store, 
classroom, and control) one class had to be 


Mean Scores On 
Mean 
Gains 


14. 68 
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47.91 
52. 32 
53. 18 


Poromne 
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eliminated in order to have groups that were 
homogeneous with respect to the retest scores. 
School A had to be eliminated from the store 
group, School E from the classroom, and 
either School J or the poorer class from 
School G had to be eliminated from the con- 
trol group. Reference to Table I will show 
how much each of the ninth-grade classes 
that had to be eliminated differed from the 
others in the group. 

In the tenth grade the four classes com- 
prising the store group were homogeneous 
with respect to retest means, which was like- 
wise true of the four classes in the classroom 
group (See Table II). However, in the con- 


TABLE II 
MEANS OF IQ, PrETEesT SCORES, AND RETEST SCORES FOR THE TENTH-GRADE CLASSES 


Schools 
—— roup 


Mean Scores On 


Retest 


Mean 
Gains 


20. 22 
26.13 
28. 28 
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trol group, the tenth-grade class from School 
J had to be eliminated in order to establish 
homogeneity, and it will be noted that the 
achievement of the pupils in this school was 
comparable with that of pupils who had store 
contacts.* 


FINDINGS 


The difference in the achievement of the 
pupils in experimental classes with and with- 
out direct store contacts during class time 
was consistently in favor of those who had 
the contacts with the stores, both when buy- 
ing groceries and when investigating electrical 
equipment. The statistical analyses of the re- 
sults of the pencil-and-paper test are reported 
separately for the ninth and the tenth grades. 

Ninth Grade—The difference between 
store and classroom groups was in favor of 
the classes in which pupils had direct store 
contacts, whether comparisons were made 
between classes taught by the same teacher 
or by different teachers. 

Table III shows that there were significant 
differences between the mean achievement of 
the store and the classroom groups, since the 
F-ratios for the adjusted retest scores were 
8.30 and 9.98 in contrast to the tabeled 
F-ratios, at the .o1 level, of 7.04 and 6.96, 
respectively. It will be noted that in the first 
comparison classes were included from only 
two schools in which both store and classroom 

*It was discovered that the booklet, Selection and Care of 


Electrical Equipment, intended for use in experimental 
classes only had been used as a basic text in School J. 
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procedures were employed, and in the second 
comparison an additional school was added 
in which only the classroom procedures were 
used in the ninth-grade class. 


Scrutiny of Table I will show that the 
store group made a higher mean achievement 
than did the classroom group; and, therefore, 
the significant F-ratios reported in Table III 
are in favor of the pupils who had the direct 
contacts with the stores. 


Further study of Table I will show that 
the classroom group gained slightly more 
than did the control group, and the store 
group gained considerably more than did the 
control group on the pencil-and-paper test. 
However, Table III shows that only in the 
comparison of the store and the control 
groups were the differences in achievement 
statistically significant. 

In the comparisons of the classroom and 
the control groups, the differences were not 
large enough to reach the tabled F-values, 
even at the .os level. On the other hand, the 
differences in favor of the store group, when 
compared with the control groups, far ex- 
ceeded the tabled F-values at the .o1 level, 
being 30.12 and 20.12 when the tabled 
values were 6.87 and 6.84, respectively. 


The relative gains made by classes with 
and without store contacts, when both pro- 
cedures were used by the same teacher, are 
presented in Table IV in terms of standard 
deviations. 


TABLE III 


F-RaTios OF ADJUSTED RETEST SCORES OF NINTH-GRADE EXPERIMENTAL 
AND CONTROL Grourps DRAWN FROM SEVEN SCHOOLS 


Groups and Schools 
Store and Classroom 


Classroom (B, C) 
Store (B, C) 
Classroom (B, C, D) 


Classroom and Control 
Classroom (B, C, D)____.---- 
Control (G,, , H, I) 
Classroom (B, C, D)___- 
Control (G,, H, I, J) 


Store and Control 


) 
Control (G,, H, I, J) 


Observed 
F-Ratios 


Theoretical F-Ratios* 
(.05) (.01) 


8. 30 
9.98 


7.04 
6. 96 


3.99 
3. 96 


3.40 
Less than 1 


6. 48 
6. 84 


3. 92 
3.92 


30.12 
20.12 


* Tabled F-values for the appropriate degrees of freedom. 
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TABLE IV 


MEAN GAINS ON PENCIL-AND-PAPER TEST 
Mape BY NINTH-GRADE EXPERIMENTAL 
CLASSES IN THREE SCHOOLS 


Gains in SD’s 
- 96 
1.77 
43 
- 95 
. 34 
1.00 


Referring again to Table IV it will be 
observed that the mean gain of the store 
group was about twice as great as the mean 
gain of the classroom group in each of these 
three schools. 
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high gains had been made and which had been 
taught by four different teachers. Reference 
to Table II will show that the store classes 
from Schools B and D, and the classroom 
classes from Schools A and F, comprised such 
groups. 

Both classroom and store groups were sig- 
nificantly superior to the control group, as is 
clear from an analysis of Table V and Table 
II. Table V shows that the F-ratios of 53.10 
and 87.67 were strikingly beyond the .o1 
levels of 6.90 and 6.84, respectively. Table II 
shows clearly that the mean achievement of 
pupils in the experimental classes (both store 
and classroom) was distinctly superior to 
that of the pupils in the homogeneous control 
group, from which School J had been 
eliminated. 


TABLE V 


F-RATIOs OF ADJUSTED RETEST SCORES OF TENTH-GRADE EXPERIMENTAL 
AND CONTROL GroUPsS DRAWN FROM NINE SCHOOLS 


Groups and Schools 


Store and Classroom 
Store (A, B, D, E) 
Classroom (A, B, C, 
Store (B, D, E) 
Classroom (B, 

Store (B, D) 
Classroom (A, F) 


Classroom and Control 
Classroom (A, B, C, F) 
Control (G,, ,, H, I) 


Store and Control 
Store (A, B, D, E)_- 
Control (G,, ,, H, I) 


Tenth Grade—Table V shows that three 
different comparisons were made of the 
achievement of pupils in store and in class- 
room groups, and that in each comparison 
the difference was in favor of the groups with 
store contacts. In the first comparison of the 
store and classroom groups the F-ratio of 6.36 
almost reached the tabled F-ratio of 6.81; 
and in each of the other two comparisons the 
observed F-ratio exceeded the .o1 level for 
the tabled F-ratios, being 8.99 and 16.53 in 
contrast to the tabled F-ratios of 6.90 and 
6.96, respectively. In the second comparison, 
School A was eliminated, because the in- 
vestigator felt that, in some respects, the ex- 
perimental conditions existing in School A 
were not comparable to those existing in 
School B where the teacher used both store 
and classroom procedures. In the third com- 
parison were included four classes in which 


Theoretical F-Ratios 
(.05) (.01) 


6. 81 
6. 90 
6. 96 


3.91 
3.94 
3. 96 


3.94 6. 90 53. 10 


3. 92 6. 84 87. 67 


The gains made by the tenth-grade experi- 
mental classes in terms of standard deviations 
are presented in Table VI. 


TABLE VI 


MEAN GAINS ON PENCIL-AND-PAPER TEST 
MADE BY TENTH-GRADE EXPERIMENTAL 
CLASSES IN Six SCHOOLS 
Procedures; Gains in SD’s 


Store _ 2.22 
Classroom . 2. 52 


__. Store et . 62 
Classroom . 24 


44 
88 
23 
. 02 


Schools 


__..Classroom 
_— £4 
—_ 


1) 


__Classroom 


Table VI shows that in both store and 
classroom groups the gains made on the re- 
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test over the pretest were greater than 1 
standard deviation, and in all but one case 
they were equal to 2 or more standard devia- 
tions. It will be noted that the two highest 
gains, more than two and a half standard 
deviations, were made by the pupils who had 
store contacts in Schools B and D; and that 
the lowest gains, 1.44 and 2.02 standard 
deviations, were made by pupils who fol- 
lowed classroom procedures in Schools C and 


F, respectively. 
Supplementary Evidence 


Supplementary record forms provided 
opportunities for ninth-grade pupils in the 
experimental classes to rate the foods they 
and their class-mates or teachers purchased, 
and to check the procedures that they thought 
should be followed when they encountered 
certain problems in their shopping; and a 
month after completion of the foods unit to 
indicate how much buying they had done in 
the interim. 

Comparative analyses of the records of the 
ninth-grade store and classroom groups 
showed that teachers’ ratings were consist- 
ently similar to those of the pupils, and the 
mean ratings given on the foods purchased 
for class use were within approximately three 
points of the total possible score (21 in one 
device and 18 in the other). Not only were 
ratings of pupils and teachers similar, but the 
mean ratings given on the food purchased in 
both the store and the classroom groups were 
very similar. Apparently, the devices were 
sufficiently simple and objective, so that 
pupils could rate with them quite accurately, 
and a satisfactory quality of produce, both 
staples and fresh fruits and vegetables, was 
purchased for class use. 

Pupils in each class in the store group in- 
dicated three times during the experimental 
unit their judgment regarding five described 
situations, while pupils in the classroom group 
did so only at the close of the unit. There- 
fore, only the ratings made at the close of the 
unit were used in comparing the judgment of 
pupils from store and from classroom groups. 

There were marked differences in what 
pupils in the classroom and in the store 
groups said they did or would do in various 
situations. For example, when they encoun- 
tered problems pertaining to price, quality, 
or kinds of articles on sale, pupils who had 
had store contacts tended to say that they 
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would judge amounts and qualities and would 
make substitutions for various types of food 
items, whereas pupils in the classroom group 
were more likely to say that they would go 
to another store to purchase a specific item. 

It was not possible for the investigator to 
determine whether a better selection of food 
was made when a similar item was substi- 
tuted or when the specified item was pur- 
chased at another store; but their replies 
suggested that pupils who had had store con- 
tacts would be more self-reliant, and more 
likely to exercise judgment in meeting a 
variety of situations in the stores, than would 
the pupils without store contacts. 


At the close of the experimental unit, 
pupils were asked to submit unsigned state- 
ments indicating their reactions to the pro- 
cedures followed when studying selection of 
food or electrical equipment. The written 
reactions of pupils showed that those in the 
store group consistently favored having store 
experiences as a part of home economics class 
work. One-third of the pupils from the ninth- 
grade classroom group stated that going to 
the stores should have been a part of their 
class work, and many of them said that they 
disliked making out grocery orders and felt 
that this should have been omitted. 

About one month after the completion of 
the unit, the cooperating teachers secured 
unsigned reports from pupils on the buying 
they had done during one week. Only about 
half as many pupils from the store group as 
from the class group had bought no groceries 
during the week prior to the date of report- 
ing, and a significantly greater percentage of 
them made out grocery orders and bought 
groceries several times during the week. A 
greater percentage of pupils from the store 
group also went to the stores to do their buy- 
ing, although the critical ratio of the differ- 
ence between the two groups did not reach 
the five per cent level of significance. 

Pupils in the tenth-grade store groups 
checked themselves after each of the six field 
trips they took. They used a check list so 
constructed that the items would be appli- 
cable to any piece of electrical equipment, 
because it was recognized that pupils might 
investigate a different type of equipment on 
each trip. Consequently, it was not possible 
to make comparisons pertaining to similar 
articles, as was the case in the ninth-grade 
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in an attempt to evaluate changes that re- 
sulted from instruction. 

Written reactions of tenth-grade pupils to 
store and classroom procedures were similar 
to those of the ninth-grade pupils. The 
majority felt that they gained a great deal 
from store experiences, and those in class- 
room groups believed that they missed a great 
deal because they had not had field trips to 
the stores. The majority of tenth-grade 
pupils in both store and classroom groups 
listed specific items of information that they 
had learned, and reported that the booklet, 
Selection and Care of Electrical Equipment, 
had been particularly helpful. 


CoNCLUSIONS 


It seems clear from the findings of this 
study that community resources can be used 
in connection with home economics instruc- 
tion at the secondary level, and that units 
in consumer buying will be less effective when 
pupils deal merely with classroom materias 
than when they have opportunities to make 
actual contacts with stores, to see the prod- 
ucts for sale, and to talk to the merchants or 
clerks. The differences in the achievement of 
classes having store contacts and of classes 
lacking such contacts were consistently in 
favor of the former. In the ninth-grade 
classes the differences in mean retest scores 
were well beyond the .o1 level, and surpassed 
it in two of the three comparisons made of 
tenth-grade groups and almost reached the 
or level in the third comparison. Supple- 
mental evidence collected from the ninth- 
grade classes showed that the superiority of 
the pupils with store contacts was not lim- 
ited to their achievement on the pencil-and- 
paper test. Pupils who had had contacts with 
stores evidenced greater ability to make in- 
dependent decisions, to form judgments in 
the light of specific situations, and to carry 
over into home practice what they had 
learned in school regarding buying proce- 
dures. Apparently the time used in getting 
to and from the stores was more than com- 
pensated for by the values gained from the 
reality of the situation that visits to stores 
brought. 
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Another factor that made for superior 
achievement was the provision of concise, 
well-organized instructional materials for 
pupils to study. This was shown by two 
facts: (1) the differences between the experi- 
mental and the control classes were much less 
marked in the ninth-grade comparisons than 
in the tenth-grade (except in the case of 
School J); (2) the mean gains made during 
instruction in the ninth-grade experimental 
classes ranged from approximately one-third 
to one and three-fourths standard deviations; 
whereas, the mean gains in the tenth-grade 
experimental classes ranged from about one 
and one-half to almost three standard devi- 
ations. 

The reader will recall that it was only in 
the tenth-grade experimental classes and in 
the control class in School J that pupils used 
especially prepared instructional materials. 

The great differences in favor of the tenth- 
grade experimental groups (both store and 
classroom) when comparisons were made 
with the achievement of the control classes 
(except that in School J) were due in part, 
also, to the fact that more time was spent on 
the electrical equipment unit in the experi- 
mental than in the control classes. Had the 
number of hours devoted to the unit in the 
control and experimental classes been equiv- 
alent, the differences in achievement would 
doubtless have been less marked, but they 
would undoubtedly still have been in favor 
of the experimental classes. 

Perhaps the final generalization warranted 
by the findings of the study is that teaching 
procedures are highly important determiners 
of pupil achievement and that the effective- 
ness of school instruction can be materially 
increased as teachers recognize the value of 
efficient procedures and learn to utilize them. 
Up to the present time, too little is known 
about what teaching procedures will be most 
useful with different age groups and with 
different types of material; but it is believed 
that this study has shown the value at the 
secondary level of utilizing community re- 
sources when they are closely related to the 
problems with which classroom instruction is 
dealing. 





AN EXPERIMENTAL EVALUATION OF THE 
SCHOOL EXCURSION' 


ELia CALLISTA CLARK 
State Teachers College, Winona, Minnesota 


INTRODUCTION 


Despite the increasing use of the school 
excursion in the elementary grades, the pub- 
lished literature contains no description of 
scientific studies designed to evaluate the 
contributions of the excursion in the elemen- 
tary school. The scientific viewpoint in edu- 
cation suggests that experimental evaluation 
be used to test the assumed values commonly 
attributed to any teaching technique, in order 
to discover the extent to which the claims 
postulated for it are realized. This seems to 
be especially pertinent in the case of the ele- 
mentary school excursion, which constantly 
is receiving greater emphasis. There is, of 
course, a severe limitation of techniques 
available for a study of this kind, since some 
results are capable of some objective meas- 
urement, while others are extremely difficult 
to evaluate. Notwithstanding this handicap, 
undertaking such an experiment appeared 
both challenging and promising. Accord- 
ingly, the present experiment was carried out 
in an attempt to determine what contribu- 
tions the excursion might yield in four sixth 
grade units: Egypt, Printing, Transportation, 
and Communication. Previous to making the 
study, the writer conducted a careful search 
of all published literature relative to the 
school excursion. 


The varying amount of current literature 
that appears from one period to another may 
be considered an index of the trend of in- 
terest in the school excursion. Therefore, it 
is interesting to note that up to 1920 only 
scant reference to the excursion is recorded 
in the literature. However, the trend from 
then forward is toward a decided increase in 
the number of articles appearing. For the 
five-year period, 1920-1924, only 4 articles 
appeared; during the interval, 1925-1929, 
the number rose to 19; while from 1930 to 
1934 the articles reached 45; and for the 
period, 1935-1939, 185 articles appeared. 
However, despite this rapid increase in the 


1 Report of a study conducted to meet wirements of a 
Doctor of Philosophy degree, University of Minnesota, 1942. 
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number of published references to the excur- 
sion, a perusal of the literature shows that 
most of the pronouncements concerning the - 
value of the excursion are in the realm of 
opinion; very few experimental evaluations 
have been recorded, and none of these repre- 
sents the elementary school. Yet interest in 
the excursion has shown unusual growth. In 
fact, some school systems have established 
special departments to care for school excur- 
sions. Therefore, it appeared that an experi- 
mental evaluation of the excursion at the 
elementary level would make a definite and 
timely contribution to education. 


PLAN OF THE STUDY 


The present experiment was carried out in 
an attempt to identify some of the contribu- 
tions that the excursion, as used here, 
yielded in four sixth grade units: Egypt, 
Printing, Transportation, and Communica- 
tion. As used in this study, the tetm, excur- 
sion, refers to any carefully planned trip that 
a group of pupils makes as a part of regular 
school work, in order to attain specific edu- 
cational objectives. 

In designing the study, statistical treat- 
ment of results and the planning of the 
experiment have been considered as two 
fundamental aspects of a single problem. Be- 
sides, from the outset, a definite effort was 
put forth to make this a_ self-contained 
experiment. 

One of the distinguishing characteristics 
of this study is the fact that the experimental 
data came from regular classroom situations 
that were closely planned, but in which a 
deliberate attempt was made to create no 
abnormal school situations. It was the pur- 
pose of this study to evaluate as well as pos- 
sible the excursion when used in a natural 
school environment. 

Choice of Units, Locale, and Teachers for 
the Experiment —After careful study, as well 
as preliminary try-out of many different units 
in various grades, the four sixth grade units 
of Egypt, Printing, Transportation, and 
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Communication were chosen, because—they 
seemed to afford promising excursion possi- 
bilities and also seemed to represent at least 
a semblance of comparative difficulty and 
length. However, the experimental design 
. provided for separate interpretation of the 
results for each unit. The excursion selected 
for each of the units was as follows: 


Egypt—The Egyptian room at the Minne- 
apolis Institute of Arts. 

Printing—A trip through the plant of a 
Minneapolis daily newspaper. 

Transportation—A trip from Minneapolis 
to St. Paul on the streamlined train, The 
Hiawatha, and return by bus. 

Communication — The main Minneapolis 
telephone exchange. 


Preliminary trial of the experiment in three 
separate Minnesota schools demonstrated 
many serious disadvantages, owing chiefly to 
the difficulty of getting teachers together for 
meetings, the impracticability of having all 
schools use the same excursion site, and cer- 
tain varying administrative features. Inas- 
much as experimental design demands that as 
nearly as possible uniform conditions be 
maintained for all participating schools, it 
seemed wise to choose all the cooperating 
schools from one system. In order to reduce 
teacher differences and to secure an un- 
biased evaluation, it seemed advisable to 
select teachers who not only possessed skill 
in teaching in the control situation, but who 
could also use the excursion well. Considera- 
tion of all these factors pointed toward the 
desirability of carrying out the study in the 
Minneapolis public schools that appeared to 
afford promising opportunity for maintaining 
satisfactory experimental conditions. Conse- 
quently ten Minneapolis teachers were chosen 
to participate in the study. Each of these 
had straight six-A grades. They also evinced 
sufficient professional interest and alertness 
to justify the expectation that the extra work 
involved in the study, planning, and keeping 
of reliable records requisite to the successful 
conduct of the experiment would be done in 
a creditable manner. When the first unit was 
almost completed, one of the participating 
teachers had the misfortune of being in a 
serious accident, which necessitated her 
absence from school during the remainder of 
the year; this reduced to nine the number of 
experimental schools. The pupil distribution 


EVALUATION OF SCHOOL EXCURSION 11 


in these schools was as listed in Table I. A 
total of 335 sixth grade children took part 
in this experiment. 
TABLE I 
DISTRIBUTION OF PUPILS IN THE EXPERIMENT 
Girls 
23 
24 
14 
15 
24 
22 
14 


15 
21 


172 





At the same time, another major purpose 
dominated this study. So often in educational 
experiments, when several classroom teachers 
cooperate in a study, they are merely tools 
for the collection of data that an investigator 
wishes to secure, and professional growth for 
the teachers usually represents a minimum. 
This need not be true. At the same time the 
teachers’ efforts are being used to make a 
contribution to additional educational 
knowledge, provision may also be made to 
give cooperating teachers functional contact 
with the systematic application of the experi- 
mental method of attack on their every-day 
classroom problems. The growing popularity 
of the so-called “work-shop” courses attests 
to the eagerness of teachers to take advan- 
tage of opportunities to gain first-hand con- 
tact with cooperatively planned experimental 
evaluation. Accordingly, this study was 
planned, not only as a device for securing 
reliable data through collective research, in 
order to avoid uncritical acceptance of gen- 
eralizations based on but a single situation, 
but it was also designed as a teacher-training 
technique. If this objective were to be real- 
ized, two requirements must be met. The 
necessary theory underlying the experimental 
method must be carefully organized and pre- 
sented to the teachers, and the teachers must 
be given an opportunity to take part in a 
cooperative development and evaluation of 
the experimental plan. Therefore, this study 
was launched as a work-shop application of 
cooperative evaluation of the excursion tech- 
nique. A series of meetings provided in- 
service training of teachers and afforded them 
an opportunity to study experimental evalua- 
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tion. It was also the purpose of these meet- 
ings to help develop in the cooperating teach- 
ers the scientific attitude toward the study, 
so that they would view in an objective man- 
ner this effort to secure experimental proof 
as to what changes occur in the behavior of 
pupils who use the excursion, as compared 
with those who do not. 


MEASUREMENT OF INSTRUCTIONAL EFFECT 


No tests were available that would ade- 
quately measure achievement in the instruc- 
tional units of Egypt, Printing, Transporta- 
tion, and Communication at the sixth grade 
level. Therefore, after careful setting up of 
objectives for each unit, tests were con- 
structed and tried out and revised several 
times in a three-year preliminary study. In 
order to validate the subject-matter content 
of each test, each item included was checked 
for its frequency of inclusion in six sources. 
The trial form of the test was then carefully 
edited by several persons in an attempt to 
evaluate each item on the basis of its func- 
tioning content. Following a preliminary 
try-out of the tests with 100 six-A pupils not 
included in the final experiment, certain test 
items were eliminated, if all or none of the 
children had answered them correctly, or if 
the discriminating power of any item was 
inadequate. 

To determine the reliability of the achieve- 
ment tests, the method described by Rulon? 
was used. The formula referred to is: 

oe 
=I ——; 
or 


Every item of the information covered by 
the test items was presented to both experi- 
mental and control groups during the two- 
week period while the unit was being studied 


® Phill . Rulon, “A Simplified Procedure for Determining 
the Reliability of a Test by jit-Halves,”" Harvard Educe- 
tional Review, 1X (January, 1939), 99-103. 
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during the final experiment; thus the test 
favored neither group. 

As is shown in Table II, the types of ques- 
tions used in the achievement tests consisted 
of completion, multiple choice, matching, and 
arrangement items. Table II also shows that 
from 40.7 to 42.5 per cent of the questions 
in the various tests could have been answered 
by a child who had no other contact, with the 
materials of instruction than that afforded by 
the excursion content, which, it must be re- 
membered, was presented to both experi- 
mental and control groups. 

Tests Other Than Achievement.—As 
Dewey’ pointed out: 

“Perhaps the greatest of all pedagogical fal- 
lacies is the notion that a person learns only 
the particular thing he is studying at the 
time. Collateral learning in the way of forma- 
tion of enduring attitudes, of likes and dis- 
likes, may be and often is much more impor- 
tant than the spelling lesson or the lesson in 
geography or history that is learned. For 
these attitudes are fundamentally what count 
in the future. The most important attitude 
that can be formed is that of desire to go on 
learning.” 

There seems to be general agreement that 
this is true, and modern education attempts 
to do something about it despite the fact that 
measurement in this field is beset with 
obstacles. Accordingly, in this study it 
seemed desirable to incorporate into the test- 
ing program some means of determining pupil 
changes of this type. The following four 
methods were used: 

1. For each unit an interest test was con- 
structed; it consisted of from 40 to 60 items, - 
which pupils marked “like”, “dislike”, or 
“indifferent”. As was the case with the 
achievement test, the interest test was ad- 
ministered before and after each of the two- 


John Dewey, Experience and Edycation, p. 49. New York: 
Macmillan Co., 1938. 


TABLE II 
ANALYSIS OF TYPES OF QUESTIONS IN THE INFORMATION TESTS 


Multiple 
Choice 
30 (14)* 
27 ( 9)* 
29 (17)* 
23 (12)* 


Match- 


Per Cent 
of Total 


Ex- 
cur- 
sion 

ing ment Total Total* 


15 ( 7)* 72 30 
7 ( 6)* 


5 
6 ( 6)* 72 30 


24 (15)* 80 34 
86 85 


* Number of questions the answers to which were supplied by the excursion materials. 
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week units, as well as a month after the unit 
had been completed. 

2. Pupils’ free reactions to each unit were 
also secured. The day after the culmination 
of each unit each teacher asked her pupils to 
write approximately a page giving their re- 
actions to the unit just completed, telling: 
(1) how they liked the unit, (2) what parts 
they had found most interesting, and (3) 
what activities related to the unit they would 
like to carry on independently. 

3. All cooperating teachers kept a diary 
and anecdotal record of pupils’ reactions to 
the various units as the experiment pro- 
gressed. From conversation, interview, and 
observation of the behavior of pupils teachers 
listed appreciations, leads into further activ- 
ity, desire to repeat experiences, and any 
other items which to them seemed pertinent 
to a complete evaluation of the experiment. 

4. Things which the children made during 
the experiment were saved for later evalua- 
tion. Included were objects, models, speci- 
mens, poems, stories, lists, and many other 
interesting products. 


EXPERIMENTAL CONTROLS 


In so far as possible, the observed differ- 
ences between the effects of the experimental 
and control techniques must be due to the 
experimental factor, if conclusions are to be 
justified. It follows that maintenance of ade- 
quate experimental controls is of fundamental 
importance to a self-contained experiment. 
Therefore, a plan was devised whereby it 
seemed that many non-experimental factors 
could be fairly well controlled. This was 
done in the ways described in the succeeding 
paragraphs. 

Teacher Training —First of all, it was 
necessary to attempt to insure equally effec- 
tive teaching in both experimental and control 
groups; every teacher must understand and 
carefully follow every step in the procedure 
which they cooperatively adopted; and the 
teachers’ personal bias either favoring or 
opposing the excursion must be reduced to a 
minimum. In an attempt to accomplish these 
objectives, all teachers had a period of train- 
ing that preceded, paralleled, and followed 
the experiment. In these meetings all steps 
of the procedure were carefully worked out 
and discussed, the underlying theory with its 
implications was emphasized, and adequate 
illustration was given as needed. After each 
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meeting, every teacher received a typed copy 
of the complete directions in which had been 
incorporated any worth while suggestions 
made during the meeting. 

Teachers’ Diary Record——Each teacher 
kept a detailed diary and anecdotal record 
of how each unit was taught; included also 
were any pupil reactions that appeared perti- 
nent. In collating and interpreting results, 
this record proved invaluable, for it facili- 
tated checking on any departure from pre- 
scribed procedure that might have influenced 
the-results obtained. It also provided insight 
into classroom techniques employed, and sup- 
plied valuable information concerning pupils’ 
reactions. 

Constant Pupil Factors—For both experi- 
mental and control groups the following 
conditions were maintained throughout the 
experiment. (1) Both groups had the same 
content presented to them. Material covered 
by the experimental group through the ex- 
cursion was presented to the control group 
from mimeographed or printed material and 
with the aid of pictures. In other words, each 
group was given the best available instruc- 
tion in each unit. (2) Both control and ex- 
perimental groups spent the same amount of 
time (two weeks) on each unit. (3) The 
same unit was presented in all cooperating 
schools at the same time. 

Rotation of Schools—In order to reduce 
further any teacher bias toward the experi- 
mental factor, schools were rotated, so that 
each school which acted as a control group 
on one unit became an experimental group 
on the next unit. The rotation plan provided 
a challenge to participating teachers to do 
effective teaching in both experimental and 
control situations, since each teacher taught 
both types of units. Rotation also tended to 
reduce the danger that any school which 
might be superior or inferior could in any 
way “load the findings”. 

Zero Control School—tIn many studies the 
question arises as to how much of the demon- 
strated growth presumably attributable to 
the experimental factor may be due to such 
factors as maturation, practice effect, and 
unreliability of tests. In order to provide a 
basis for estimating what changes might 
ordinarily take place in pupils who did not 
receive systematic instruction in the experi- 
mental content, a St. Paul sixth grade con- 
sisting of 19 boys and 20 girls was chosen 
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as a zero control group. The pupils in the 
zero control group received no instruction in 
the units concerned; in fact, the teacher 
made a definite effort to eliminate all such 
content from her teaching during this period. 
However, the teacher administered to her 
pupils all the tests on the same days that the 
experimental schools took them. It seemed 
that any growth shown by pupils in the zero 
control group might thus be attributed to 
such factors as maturation, practice effect, 
and unreliability of tests. Hence, in the 
analysis of experimental results, considera- 
tion of this information facilitated a more 
accurate evaluation of pupil growth due to 
the instruction involved in the experimental 
units. 


CHARACTER OF THE EXPERIMENTAL SUBJECTS 


Intelligence quotients of the subjects of 
this .experiment were secured from the 
Kuhlmann—Anderson Group Intelligence Test 
for sixth grade. The mean intelligence quo- 
tient for the separate schools varied from 
95.73 to 106.41, with a mean of 1ro1.14 and 
a standard deviation of 9.38 for the total 
group. Analysis of variance of chronological 
age indicated homogeneity at the one per 
cent level. In both intelligence quotient and 
mental age, analysis of variance indicated 
heterogeneity. However, in the statistical 
analysis, mental age is one of the basic 
matching characters. 

As to sex, the experimental subjects were 
balanced within narrow limits. The slight 
difference made it appear rather doubtful 
that it would affect results to any pronounced 
degree. However, to test that assumption for 
each unit, a chi-square test of sex distribution 
was made, and in no unit was a significant 
sex difference found between the control and 
experimental groups. 

The socio-economic status of each pupil 
was determined by applying the “Alphabetical 
Occupational List for Classification of Occu- 
pations by Minnesota Occupational Scale”* 
to the data given on the pupil’s individual 
record card. For each unit, application of 
Brandt’s method of the chi-square test indi- 
cated that the differences between the distri- 
butions of the control and the experimental 
groups in socio-economic status were not 


significant. 
E. Anderson, Experimental 


* Florence Goodenough and J. 
Child Study, pp. 501-512. New York: Century Co., 1931. 
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STATISTICAL TECHNIQUES 


The main statistical techniques employed 
in this study include chi-square, analysis of 
variance, the Johnson—Neyman analysis, and 
the Harris technique. These were used as 
described in the following paragraphs. 


In order to test the significance of the 
difference in socio-economic distributions of 
the control and experimental groups in each 
unit, Brandt’s method of chi-square was used. 
For no unit was a significant chi-square 
found; therefore, for edch of the four units 
the socio-economic status may be regarded 
as homogeneous. Another application of the 
chi-square test was made to determine 
whether the sex ratio among schools differed 
significantly. For no unit was a significant 
chi-square fotind, thus indicating that for 
each control group, as well as for each ex- 
perimental group, there was no significant 
difference in sex proportion. However, since 
the requirement of proportionate frequencies 
was met by the data only approximately, 
Snedecor’s adjustment was used in making 
the analysis of variance. \ 


Because of the practical difficulty of mak- 
ing each school an experimental unit in itself, 
it was necessary to determine whether the 
data from the several control schools could 
be collated and also whether the same could 
be done for the experimental schools. In order 
to make this test of homogeneity, analysis of 
variance involving two criteria with cross- 
classification was employed. In cases where 
heterogeneity prevailed, it was necessary to 
subdivide groups into homogeneous units. 
For example, in the unit on Printing, it was 
found that the experimental schools were 
heterogeneous according to analysis of vari- 
ance on final test scores; thus breaking the 
group into homogeneous units resulted in 
having two experimental units, each of which 
was then compared with the control schools. 

However, before the method of analysis of 
variance could be applied, it was necessary 
to test whether the variances within groups 
were uniform. To test whether this condition 
prevails when only two groups are under 
consideration, the exact statistical test is the 
Z-test.. When more than two groups are 
under comparison, the approximate test sug- 
gested by Welch with the use of Nayer’s 
tables of the sampling distribution of the 
criterion L, can be employed. 


‘ 
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The Johnson—Neyman technique is the 
basic statistical tool used in interpreting the 
data obtained in this study. The functions 
of this technique are: (1) to ascertain 
whether the experimental group differed sig- 
nificantly from the control group on the final 
test scores and (2) to determine the region 
of significance which defines that part of the 
population for which any differences found 
are significant. The Johnson—Neyman tech- 
nique also permits use of all data collected. 

It will be recalled that the analysis of 
variance indicated heterogeneity for the 
schools as a whole on mental age; therefore, 
there appeared need for controlling this 
characteristic. High correlation was found to 
exist between pretest and final test; for this 
reason it seemed advisable to match on pre- 
test scores as the second basic characteristic. 
In this statistical analysis, then, the basic 
matching characters are mental age and pre- 
test score, and the final score (obtained at 
the end of the two-week unit) is the criterion. 

As previously stated, four weeks after each 
unit was finished, the achievement test was 
given again to measure retention of informa- 
tion at the end of that interval. In order to 
determine whether pupils who had the high- 
est final scores (at the end of the unit) also 
had the highest retention scores, the 
product-moment coefficient of correlation 
was computed for both experimental and con- 
trol groups. The degree of relationship 
shown by the correlation coefficient indicated 
the extent to which those pupils who had the 
most information at the end of the unit 
remembered absolutely more at the end of 
the four-week interval. However, these co- 
efficients do not answer the question of 
whether the individual who had the most 
information at the time of completing the 
unit retained relatively the most four weeks 
later. To obtain this information the Harris 
technique*® was used. 


FINDINGS OF THE EXPERIMENT 


Achievement.—In the Egypt unit no sex 
differences appeared. The control group was 
significantly superior to the experimental 
group on the basis of final test scores when 
mental age and pretest scores were held con- 
stant. The region of significance is bounded 
by an hyperbole. Within the region of sig- 

‘Arthur J. Harris, “The Correlation between a Variable 


and the Deviation of a Dependent Variable from Its Probable 
Value”, Biometrika, V1, 438-443. 
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nificance the value of F is favorable to the 
control group. That value is significant for 
that part of the population which falls 
within the hyperbole. Here the level of sig- 
nificance is F — .o1. In other words, pupils 
whose initial scores and mental ages lie 
within the region benefitted significantly more 
if they were in the control group than if they 
were in the experimental group. Broadly 
speaking, pupils in the range from o to 37 
on pretest and from a mental age of approxi- 
mately 110 to 167 profited more from the 
control method. The best estimate of the true 
difference between the means of the control 
and experimental groups is 14. There was no 
significant difference in either absolute or 
relative retention for the experimental and 
control groups. 


In the Printing unit no sex differences were 
found. For the control group, analysis of 
variance of final test scores with two criteria 
involving cross-classification indicated homo- 
geneity; therefore, the control schools could 
be collated and regarded as homogeneous. 
However, in the experimental group the 
schools were not homogeneous (F =— 5.5, 
which exceeds even the one per cent tabled 
value). Thus, it was necessary to subdivide 
the experimental schools into groups that 
were homogeneous. The t-test indicated that 
the experimental schools could be subdivided 
into two homogeneous groups. The Johnson— 
Neyman analysis was then used to compare 
the final test results secured in each of these 
two experimental groups with the final scores 
secured in the control group. In both cases 
the means of final scores for the two experi- 
mental groups were significantly the greater 
when adjusted for pretest scores and mental 
age. For the first experimental group a region 
of significance bounded by an ellipse exists at 
the one per cent level. Those persons whose 
mental ages (100-140) and pretest scores 
(o-37) fall within the region of significance 
profited significantly more if they were in the 
experimental group than if they were in the 
control group. The best estimate of the true 
difference between the means of the control 
group and the first experimental group is 4. 


In the case of the second experimental 
group in the Printing unit a region of sig- 
nificance (an ellipse) exists at the one per 
cent level favoring the experimental group. 
Broadly speaking, persons having mental 
ages of from 130 to 137 and pretest scores of 
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from 4 to 44 may be expected to do better 
on the final measurement, if they are mem- 
bers of the experimental group. The best esti- 
mate of the true difference between the means 
of the control group and the second experi- 
mental group in the Printing unit is 9. 

So far as retention is concerned, in the 
comparison of the control group with the first 
experimental group, the control group was 
superior in absolute retention; while, in the 
comparison of the control group with the sec- 
ond experimental group, there was no sig- 
nificant difference. In relative retention there 
was no significant difference in the Printing 
unit. 

The Transportation unit was the only one 
of the four units that revealed sex differences; 
these appeared in both control and experi- 
mental groups, thereby necessitating analysis 
separately by sex. The Johnson—Neyman 
analysis of final test scores of the control boys 
and the experimental boys, using mental age 
and pretest score as basic matching charac- 
ters, shows results favorable to the experi- 
mental boys. A region of significance that is 
bounded by an hyperbole exists at the five 
per cent level. It indicates that, in general, 
boys with mental ages of from about 110 to 
125 and pretest scores of from about 35 to 60 
would tend to profit more from the experi- 
mental method than from the control method. 
The best estimate of the true difference be- 
tween the means of the control and experi- 
mental boys is 1.9. In relative and in abso- 
lute retention there was no significant differ- 
ence between the scores of the boys in the 
control and experimental groups. 

Similarly, a Johnson—Neyman analysis was 
made of girls’ scores in the control and ex- 
perimental groups for the Transportation unit, 
but there was not sufficient evidence to reject 
the hypothesis that there is no real difference 
between the means of final scores for the two 
groups when of the same initial scores and 
mental ages. In absolute and relative reten- 
tion there was no significant difference be- 
tween control and experimental groups of 
girls. 

In the Communication unit the Johnson— 
Neyman analysis of final test scores for 
experimental and control groups showed that 
the experimental method was superior to the 
control method. A region of significance 
bounded by an ellipse exists at the one per 
cent level. In general, all pupils with mental 
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ages of from 131 to 174 and pretest scores of 
from 17 to 54 may be expected to profit sig- 
nificanty more if in the experimental rather 
than the control group. The best estimate of 
the true difference between the means of the 
control and experimental groups is 5.9. 

In the Communication unit there was no 
significant difference between the control and 
experimental groups in either absolute or 
relative retention. 

Zero Control School_—As explained above, 
a St. Paul sixth grade had been selected to 
act as a zero control group. These pupils had 
no contact with the experimental instruction, 
but they took all the tests at the same time 
the children engaged in the experiment took 
them. For each of the four units, data con- 
cerning tests of significance of the difference 
between the means of the several tests on 
each unit for the zero control group indicate 
that in no case was a difference found to be 
significant. Therefore, it is highly probable 
that, in this experiment, obtained gains were 
due to instruction rather than to outside 
influences. ’ 

Interest Tests—For each unit the re- 
sponses of each child on the pretest, final, 
and retention tests were tabulated and the 
number of responses of “like”, “imdifferent”’, 
and “dislike” for each item by every child 
was summated. After the same procedure was 
carried out for both experimental and control 
groups, a chi-square test was applied. In no 
unit were the differences obtained significant. 

Children’s Written Reactions —It will be 
recalled that at the end of each unit each of 
the participating pupils wrote approximately 
a page: (1) telling how he liked the unit, 
(2) mentioning the items that had proved 
most interesting, and (3) listing activities 
he wished to carry on independently now 
that the unit was finished. An attempt was 
made to secure the children’s free reactions; 
teachers were asked to make no suggestions 
as to what pupils should include. Every child 
was requested to write exactly as he felt 
about it. For all units the general tone of the 
written reactions reflects sincerity and con- 
siderable thoughtful evaluation. In order to 
interpret these data, an attempt was made to 
analyze the pupils’ statements objectively. 
For example, topics that pupils listed as most 
interesting in the unit were arranged in order 
of frequency in a table, which also indicated 
the number and percentage of boys, girls, and 
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total pupil group in each of the experimental 
and control groups that mentioned the item. 
Since children’s written reactions appeared to 
be particularly interesting for every unit, a 
resumé of their responses, as made at the end 
of the Printing unit, is given here as an 
example. There is no particular reason for 
choosing the Printing unit, for all four units 
yielded results-of similarly high interest, so 
any one of them may be regarded as typical. 


For the Printing unit the excursion group 
listed 22 different topics as being most inter- 
esting; only eight of these were mentioned 
by the control group.-On the other hand, the 
control group listed 17 topics, nine of which 
were not included in the 22 given by the 
excursion group. In the experimental group 
54 per cent of the pupils stated that the ex- 
cursion was the most interesting part of the 
Printing unit. Furthermore, having seen the 
machines in operation, it is not surprising 
that 11 of the topics the experimental group 
listed concern machines. On the other hand, 
the control group, having viewed pictures 
while they heard an explanation of the oper- 
ation of these machines, failed to include 
them as frequently among the most interest- 
ing items. Here, as in the other units, pupils 
participating in this experiment tended to 
express greater interest in objects they had 
actually seen than in those presented to them 
verbally and pictorially. Apparently seeing 
actual objects makes these objects more 
meaningful to the pupils than if a vicarious 
experience is substituted. Pupils’ comments 
as quoted later further emphasize this fact. 


In addition to topics that pupils listed as 
being most interesting, the activities they 
evinced interest in carrying on independently 
after the unit was finished are also indicative 
of the value they attach to the unit. The 
extent to which any school experience affects 
pupils’ subsequent activities is to a certain 
extent a measure of its richness. As was done 
in the case of topics the pupils listed as most 
interesting, a similar frequency table was 
made, showing the activities they expressed 
a desire to carry on independently. Again 
using the Printing unit as an illustration, it 
is interesting to note that, although 54 per 
cent of the experimental group had listed the 
excursion as the most interesting item in the 
Printing unit, 21 per cent stated that they 
wished to revisit the newspaper plant. In this 
desire they are consistent in attaching value 
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to the excursion. Likewise, 24 per cent of the 
control group expressed their desire to visit 
a newspaper plant, indicating a felt need for 
direct experience such as the excursion offers. 
Children in the experimental group mentioned 
with greater frequency that the Printing unit 
had proved interesting. Careful consideration 
of all factors involved in the unit, as it was 
taught in this study, reveals no non-experi- 
mental factor to which this difference in atti- 
tude may be attributed; therefore, it appears 
probable that the experimental children liked 
the unit better than did the control pupils, 
because they had taken the excursion. Teach- 
ers’ diaries and anecdotal records connected 
with the unit further emphasized this prob- 
ability. 

It is difficult to convey an accurate impres- 
sion of how pupils seemed to feel about a 
unit, unless one quotes them directly. 
Acccordingly, a few typical excerpts from 
pupil’s written reactions to the Printing unit 
are quoted below. The assignment that pre- 
ceded the writing of these papers, it should 
be recalled, included no mention of the ex- 
cursion. Pupils who referred to it did so vol- 
untarily. They volunteered such statements 
as the following: 


“T enjoyed the excursion to the news- 
paper plant immensely and feel that our 
whole class learned much more from going 
to the plant than we would have under- 
stood in any other way.” 

“Tt is very interesting to watch the 
bundles of papers being tied with wire. It 
is clever the way it works. I like to watch 
the matrix being made. It’s all very inter- 
esting. I hope I can go again sometime.” 

“In the study of Printing I liked the 
trip very much. It was fun to go to a real 
newspaper office to see a real newspaper 
printed.” 

“Visiting the newspaper plant increased 
my vocabulary a great deal.” 

“T have enjoyed finding out new things 
about printing more now than before the 
excursion.” 


Several pupils in the control group referred 
to vocabulary difficulties encountered, and 
some suggested a desire to secure meaningful 
impressions of these new words by visiting 
the newspaper plant. They said: 


“Some parts of the Printing unit I liked; 
others I didn’t. There were so many words 
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I can’t remember. I can’t remember the 
difference between a chase and a cut. I 
wish we could really visit a newspaper 
plant.” 

“T liked the unit pretty well, but it was 
very hard to keep the words and their 
meanings straight. Some day I mean to go 
to a newspaper plant and see how the daily 
newspaper is made.” 

“T hope my father takes me to see how 
a newspaper is printed. It must be fun to 
see all the processes right before your 
eyes.” 


Indicative of an appreciation of certain 
aspects of printing, the following statements 
are quoted from reactions of pupils who took 
the excursion to the newspaper plant: 

“The study of printing was extremely 
interesting. The wire-photo, teletype, en- 
graving, and linotype were the things that 
particularly interested me during the trip 
through the newspaper office, and it isn’t 
until you see it before your own eyes that 
you realize how much work is put in on the 
few pages of paper that you can sit and 
enjoy at home at such little cost. It is not 
until you have the facts before your eyes 
that you realize how hard the men em- 
ployed by the newspapers have to work to 
be in the position where they are today. 
From the editors even down to the men 
who run the presses they all work hard 
and do their best to publish the best news- 
paper possible. These men should be con- 
gratulated on the splendid example they 
have set for American industry.” 

“T like Printing better than the Egypt 
unit. Since I visited the newspaper plant, 
I know how hard it is to print books and 
newspapers. From now on I am going to 
take better care of them.” 

“When I got home from the newspaper 
plant and read the paper, it seemed more 
interesting to know how many people work 
to give us the news we read.” 

“Since my visit to the newspaper plant, 
I take more interest in the newspaper; I 
don’t just read the funnies any more.” 

“Since I have been through a newspaper 
plant where I saw all the work they put on 
the paper, it makes me much more inter- 
ested in the paper. I read many more parts 
of the paper now because I think it is more 
interesting after you see how much work 
they put on it.” 
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SUMMARY OF CONCLUSIONS 


The purpose of this study was to determine 
what contributions the excursion might yield 
in four sixth grade units: Egypt, Printing, 
Transportation, and Communication. In no 
unit except Transportation were sex differ. 
ences found. In a comparison of control and 
experimental groups, in means of final scores 
when adjusted for mental ages and pretest 
scores, the following groups were found to be 
significantly superior: 

Egypt—control group. 

Printing—experimental groups. 

Transportation—experimental boys. 

Communication—experimental group. 


There were no significant differences be- 
tween control and experimental groups in 
absolute retention, except in the case of the 
Printing unit in which the control group was 
significantly superior to one of the two 
experimental groups. 

In relative retention there was no signifi- 
cant difference between control and experi- 
mental groups in any unit. 

Results secured with a zero control group 
that had no classroom instruction in the con- 
tent of any unit, but took all tests on sched- 
ule, indicated that factors such as maturation 
and practice effect had not influenced signifi- 
cantly test scores for these units. Therefore, 
it is highly probable that in this experiment 
obtained gains were real gains due to in- 
struction rather than to outside influences. 

Chi-square tests of the distributions of re- 
sponses of “like”, “indifferent”, and “dislike” 
for items in each interest test revealed no 
significant differences between the control 
and experimental groups. 

Children’s voluntary reactions written at 
the end of each unit indicate that the pupils 
who went on the excursion recorded for each 
unit a greater variety of items which espe- 
cially interested them. They also listed with 
greater: frequency a wider variety of activities 
in which they stated they would like to 
engage after the unit was finished. 


EDUCATIONAL IMPLICATIONS OF THIS STUDY 


The evidence presented through this study 
points to the definite need for careful prepa- 
ration in the use of the excursion. In this 
investigation not only were teachers and 
pupils carefully prepared to secure maximum 
benefits from each excursion, but at the same 
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time the administrative aspects were cared 
for, perhaps as effectively as any similar well- 
organized set-up could provide. It is perti- 
nent to remember that the gains found in this 
study were achieved under conditions in 
which: (1) an appropriate excursion was 
carefully selected; (2) teachers had received 
systematic in-service training in the use of 
the excursion and its underlying psycholog- 
ical implications; (3) pupils had developed a 
purposeful attitude toward the excursion as 
valuable source material; (4) administrative 
difficulties had been reduced to a minimum; 
(5) appropriate guide service was provided 
on each excursion; and (6) the results of the 
excursion were utilized in subsequent class 
discussion. This study supplies no basis for 
the assumpiion that positive results will be 
obtained with excursions, unless similar con- 
ditions of careful planning are fulfilled. 

On the other hand, it must be borne in 
mind that the control groups in this study 
also received the best possible instruction 
under the given circumstances. The control 
group had contact with all the information 
that the experimental group saw on the ex- 
cursion. In all probability, few teachers not 
using the excursion would have this material 
available. 

The findings of this study further suggest 
| that teachers must constantly evaluate the 

excursions they use. Some of them may not 
be bringing about the hoped-for results. In 
an elementary-school survey, Borgeson® found 
that excursions to museums were the most 
popular school excursions. Supporting this 
practice, Atyeo’s study’ found further that, 
in a museum type of unit, results definitely 
favored the experimental group of ninth grade 
children. By way of contrast, in the present 
study, the museum type of excursion was the 
only one of four excursions studied in which 
differences favored the control group. To- 
gether these studies constitute an argument 
against generalizing for all situations on the 
basis of either present practice or the evidence 
presented by one experiment. 

Perhaps one of the paramount values of the 
excursion, aside from its success in aiding in 
the acquisition of knowledge, is another 

*F. C. Borgeson, “E in School Life,” Bulletin of 


‘ . xcursions 
the Department of Elementary School Principals, XI (April, 
1932), 461-66. 
‘TH. C. Atyeo, The Excursion as a Teaching Technique. 
Teachers College Contributions to Education, No. 761. New 
York: Teachers College, Columbia University, 1939. Pp. 225. 
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aspect which does not lend itself readily to 
evaluation; that is, its power to develop in- 
terests, ideals, and appreciations. The find- 
ings of this study indicate that the pupils 
who took the excursion showed at the end of 
the unit evidence of broader interest than 
pupils who did not take the excursion. Of 
course, this furnishes no evidence of the ex- 
tent to which these declared interests eventu- 
ated in worthwhile subsequent activities. 
That remains a problem for future investi- 
gation in a field which bristles with interest- 
ing challenges. 


Another implication that may be of par- 
ticular interest to the experimental research 
worker emanates from teachers’ reactions to 
having cooperated in such a study on the 
work-shop basis. All teachers concerned ex- 
pressed definitely favorable attitudes toward 
the opportunity of having been participants 
in a study in which the emphasis was placed 
not merely on the collection of factual mate- 
rial for someone else’s use, but also upon the 
round-table method of developing and carry- 
ing out a scientific study. All teachers stated 
that they had expended an enormous amount 
of time and energy on the work, but they 
also stated that the experience had been a 
decided challenge to them. The teachers felt 
that through participation in the study they 
had developed valuable insights into the sci- 
entific method of evaluating and improving 
their own teaching. Several requested an 
opportunity to secure further in-service train- 
ing in this same way. 

Anyone who attempts to do a piece of re- 
search involving children should be definitely 
concerned with the effects upon the child. 
Experimental research is necessary to the 
evaluation of educational procedure, but the 
subjects to be used in the experiment should 
also receive due consideration. In the present 
study, it seemed that, because of careful 
planning, pupils of both control and experi- 
mental groups were at all times spending 
their time to advantage. Children’s written 
reactions to the units included many expres- 
sions of favorable attitudes toward the pro- 
cedures being used, with no adverse criticisms. 
Therefore, it seems that, with serious consid- 
eration of the probable effects which a piece 
of experimental research may have upon 
children, an experimenter can do much to 
reduce the undesirable effects that otherwise 
might be concomitants of his study. 
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ANALYSIS OF PROBLEM 


Statement of the Problem—The purpose 
of this study was to determine the compara- 
tive effectiveness of certain diverse forms of 
pictorial teaching aids when used in teaching 
certain topics in safety educaton to pupils of 
the sixth grade of the elementary school. 

The pictorial teaching aids used in this 
study are all devices for group instruction 
using projection equipment. They are the 
sound motion picture, silent motion picture, 
silent film slide, and sound film slide. The 
four subjects on safety selected for use in the 
investigation were: automobile safety, fire 
safety, pedestrian safety, and bicycle safety. 


Specific Problems—The major problem 
divided itself into specific problems: 

1. How do the different visual media com- 
pare in effectiveness in the presentation of 
factual information on the several safety sub- 
jects? Is there any real difference between 
them to justify the setting up of special cri- 
teria for their use? 

2. Can the four safety subjects be compre- 
hended and mastered equally well by pupils 
through the use of the visual media employed 
in this study, or do any of the subjects lend 
themselves particularly well to study through 
the use of the pictorial aid? 

The problem was, therefore, to determine 
differences in the instructional outcomes for 
the media used, and the degree to which the 
differences are significant, rather than to de- 
termine whether pictorial aids are effective in 
teaching. 

Significance of the Study—The value of 
pictoria! teaching materials as aids to learn- 
ing is no longer contested. Not only educators 
but practically all government branches, both 


* Abstract of thesis submitted in partial fulfillment of the 
wirements for the of Doctor of Philosophy in the 
of Education of New York University, 1942. 


military and civilian, and business organiza- 
tions have recognized their effectiveness in an 
educational program. 

Since teachers and others are using the 
various pictorial media, in most cases indis- 
criminately, it is desirable that they have a 
basis of reliable research upon which to de- 
termine the most suitable medium for use in 
a given situation, to discover whether real 
differences do exist among the media and, if 
so, where those differences lie. 

Safety was the subject selected in this in- 
vestigation, since it is one which, in recent 
years, has received much pictorial presenta- 
tion. This is understandable. Safety concerns 
itself primarily with the actions of people. 
It is essentially a “picture” study and, there- 
fore, lends itself particularly well to instruc- 
tion through the use of pictorial materials. 
In addition, since the subject deals with acci- 
dents, involving life or death situations, 
special attention has been given to instruc- 
tion in safety for children, who need a funda- 
mental understanding and knowledge of safe 
habits and a strong “conditioning” for the 
development of proper safety attitudes. 

Some research evidence exists regarding 
the comparative effectiveness of two or three 
pictorial media; e.g., the motion picture and 
the still picture. However, in these studies, 
the pictorial material appearing in the two 
media was seldom the same or even equiv- 
alent; that is, the still pictures were not 
“lifted” from the filma/Yet no real compari- 
son can be made unless identical or equiv- 
alent material appears in the media being 
compared. In the present investigation the 
media have been made equivalent in terms 
of pictorial and textual content. The investi- 
gation attempts also to throw much needed 
light on the effectiveness of the “new” media, 
sound film slide and silent film side, as tools 
of instruction. 
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Previous RESEARCH 


A study of previous research in the field of 
visual education fails to reveal conclusive evi- 
dence that any one form of visual aid is more 
effective than another. The several studies 
reported by David Sumstine,* Joseph Weber,’ 
Frank N. Freeman,’ Daniel C: Knowlton and 
Warren Tilton,‘ Philip Rulon,® Clarence 
Clark,* Varney Arnspiger,’ Nathan Doscher,*® 
and Katherine Rose® do reveal that visual 
media make significant contributions to the 
learning process; but research evidence show- 
ing conclusively the comparative effectiveness 
of the sound motion picture, silent motion 
picture, sound film slide, or silent film slide 
is practically nonexistent. (It should be noted 
that in none of the experiments listed above 
is the silent or sound film slide dealt with, nor 
was the experimenter able to locate any 
studies in which the comparative effectiveness 
of these devices was investigated. 


DESCRIPTION OF THE EXPERIMENT 


In organizing and setting up the investiga- 
tion, one problem above all others required 
special consideration; namely, that the four 
different visual aids comprising each set of 
materials on a specific safety subject contain 
equivalent factual information. Since a com- 
parison was made between the different media 
within a set, it was essential that the sound 
motion picture, silent motion picture, silent 
film slide, and sound film slide which com- 
prised the set of media on each subject con- 
tain the same photographic and textual data, 
but differ only in the physical form and char- 
acteristics inherent in each medium. 

One such set of media was prepared for 
each of four different subjects, as follows: 
(a) auto safety, (b) bicycle safety, (c) 
pedestrian safety, and (d) fire safety. 

1“Comparative Effectiveness of Visual Education in the 
High School,” School and Society, VII (February 23, 1918), 


‘oonpentiee — of Some Visual Aids in Seventh 
Grade Instruction. Chicago: Educational Screen, 1930. 
Fs Education. Chicago: University of Chicago Press, 

* Motion Pictures in History Teaching. New Haven: Yale 
University Press, 1929. 

5The Sound Picture in suas Teaching. Cambridge: 
Harvard University Press, 1933 

*“Sound Motion +" as. an Aid in Classroom Teach- 
ing.”’ Unpublished Ph. thesis, New York University, 1942. 

* Measuring the _ of Sound Pictures as Teach- 
img Aids. New York: Bureau of Publications, Teachers Col- 
lege, Columbia University, 1933. 

*“A Critical Analysis of Some Visual Aids Used in Teach- 
ing Pedestrian Safety.”” Unpublished Ph.D. thesis, New York 
University, 1939. 

* “Motion Pictures vs. Lantern Slides in Teaching Certain 
bow 7 of Biology,” Educational Screen, XXI (January, 1942), 
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The basic medium used to determine the 
organization and development of the other 
materials was the sound motion picture, since 
it was possible to produce the other media 
working from a sound film, but impossible to 
prepare a sound motion picture from the 
other media used in the experiment. The 
sound film, therefore, had to meet a number 
of physical and educational requirements. 

After much search and careful analysis, 
four different films were obtained, each on a 
different subject, each one reel in length, each 
for approximately the same age level, each 
available in 16mm. and 35mm. size, and with 
the 16mm. size of each available in both 
sound and silent versions, so that the mate- 
rials of all the media might be equivalent. 

To prepare the film strips, the investigator 
selected from each sequence in the 35mm. 
motion picture the specific frame which in his 
judgment—-most__effectively illustrated the 
safety concept being prescribed. In this 
process approximately twenty-five photo- 
graphic frames were lifted out which pre- 
sented the safety story of the film. Approxi- 
mately twenty textual frames were then 
selected from the film which related speci- 
cally to the photographic frames previously 
selected. 

Each of the individual frames, photo- 
graphic and textual, was framed, mounted, 
and bound between two-inch square cover 
glasses, producing a set of two-inch square 
lantern slides. The “textual” slides were in- 
serted in their proper sequence among the 
photographic slides, and this lantern slide set 
was a “still” copy of the motion picture in 
which only the essential photographic and 
textual frames were used. In essence the lan- 
tern slide set was a continuous story exactly 
comparable with a silent film strip, except 
that it was not on a single strip of film. The 
same procedure was followed in preparing the 
four different lantern slide sets (or silent film 
slides). 

The sound slide film was prepared by re- 
cording all the textual frames of each slide 
set on a special disc which was synchronized 
with the photographic frames of the film 
slide set. Picture for picture and word for 
word, one written and the other spoken, the 
two film slide media were identical. 

A committee of three experts viewed the 
materials to determine whether the most 
essential safety concepts of each film had 
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been selected for use in the slide set, and 
whether the frames selected on the basis of 
safety content were also the most effective 
visually in each film sequence used. All their 
suggestions were incorporated in the final set 
of material. ‘The investigator next prepared 
four separate tests, one for each of the safety 
subjects selected. Each test consisted of fifty 
multiple-choice questions, selected after an 
analysis of the contents of each frame used 
in the lantern slide set. The fifty questions 
of each test varied in degree of difficulty. The 
tests were validated by administering them to 
six classes of sixth-grade pupils of New York 
City schools. The questions were also checked 
by sixth-grade teachers for suitability of 
vocabulary and sentence structure for that 
grade level. The easiest questions were then 
eliminated, so that the final tests comprised 
35 questions. Two different forms of each 
test were prepared. Form A was to be used 
in the pre-test part of the actual experiment. 
Form B was to be administered in the post- 
test (immediate recall) and thirty-day (de- 
layed recall) portions of the -experiment. 
Both forms of each test consisted of the same 
35 multiple-choice questions with three pos- 
sible answers for each question, but differed 
only in the order of the questions and in the 
position of the one correct answer for each 
item. 

Eight 6A classes in four elementary schools 
within adjacent districts in the Borough of 
Brooklyn in New York City, numbering 240 
pupils in all four schools, participated in the 
experiment. Approximately 130 of the pupils 
were from classes of high I.Q., while the re- 
maining 110 pupils were from low IQ. 
classes. Each school had one class of low I.Q. 
and one class of high I.Q. pupils. The range 
and mean I.Q. scores of all classes within 
each I.Q. group were fairly comparable. 

The investigator prepared a special sched- 
ule allocating the showing of each set of 
media. It was planned so that each class in 
the schools was exposed to a different visual 
medium on a different safety subject for each 
of four consecutive days. There was no repe- 
tition either of the medium or the safety sub- 
ject; that is, no class saw more than once any 
one type of medium or more than one type of 
medium on one subject. This technique of 
experimental research is known as the 
rotation-group method. It has the advantage 
of eliminating a number of variable factors, 
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such as differences in number of pupils, age, 
1.Q., etc. 

The regular classroom teacher did not 
enter into any phase of the experiment. The 
investigator himself conducted the experiment 
in each of the classes, going from school to 
school. Thus the factor of teacher contribu- 
tion in the use of visual media in a lesson 
was eliminated from the experiment. 

One regular class period of forty-five min- 
utes was devoted to the presentation of each 
medium. The period was broken up into three 
parts: part 1, first fifteen minutes, pupils 
answered pre-test; part 2, second fifteen 
minutes, presentation of medium (no pupil or 
teacher discussion); part 3, third fifteen 
minutes, pupils answered post-test. 

Thirty days after presentation of the 
media, again without any teacher or pupil 
preparation, the subjects in all the classes 
answered the post-test a second time. 


STATISTICAL TREATMENT AND ANALYSIS 
oF Data 


Although 240 pupils took part in the study, 
only 144 of them answered every one of the 
tests. Only these 144 sets of scores were used 


for calculating all results and as the basis of 
all conclusions. The statistical treatment 
divided the data into two special groups— 
those pertaining to study of the different 
media and those pertaining to study of the 
different subjects. Within each group there 
was a further breakdown in terms of all 
groups, groups of high I.Q. and groups of low 
I.Q. Correlation tables were made of all data, 
since all scores were correlated. The statis- 
tical treatment deals with two specific prob- 
lems. The first problem was to determine 
whether the gains registered between two sets 
of scores—the pre- and post-tests, and the 
pre- and 30-day test scores—were significant 
or reliable and, second, to determine whether 
there existed any differences between the 
media or any superiority of one medium over 
another in gains registered by two groups 
exposed to two different media. The statis- 
tical techniques used in arriving at the con- 
clusions of the first problem were mean 
scores. For each set of data, standard devia- 
tions, coefficient of correlation, standard error 
of difference between two means, actual dif- 
ference between two means, and reliability of 
difference between two means (critical ratio) 
were found. Whenever this ratio is 2.7 or 
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larger, it means that the difference between 
the two groups compared is greater than zero, 
that it is significant. With respect to the 
second problem, differences between media, 
the following statistical techniques were used: 
mean gains in a set of scores, standard devia- 
tions of the mean gains, the standard error of 
the differences between the two mean gains, 
and finally the critical ratio of the two mean 
gains. Again, if the critical ratio was 2.7 or 
more, it may be assumed that the gain was a 
reliable one and that the medium registering 
this gain could be considered superior to the 
one with which it was compared. 


CONCLUSIONS 


Effectiveness of the Media—All Groups.— 
1. All four media are effective devices for 
presenting safety information, as evidenced 
by the high critical ratios obtained, indicat- 
ing that real and highly significant gains were 
produced for both immediate and delayed 
recall. 

2. The silent motion picture produced the 
largest gains in test scores, for both immediate 
and delayed recall. 

3. The silent and sound film slide followed 
the silent motion picture in size of gain pro- 
duced, on both immediate and delayed recall. 
There was practically no difference between 
the two media in this respect. 

4. The sound motion picture produced the 
least gain in test scores in both instances. 

5. The silent motion pictured showed a sta- 
tistically reliable amount of superiority over 
the sound motion picture and sound film slide 
for immediate recall, and the indication was 
less sharp but still strong that it was superior 
to both for delayed recall. 

6. There was a strong indication also that 
the silent motion picture was more effective 
than the silent film slide for delayed recall, 
although not for immediate recall. 

7. The silent film slide was clearly more 
effective than the sound media for immediate 
recall, but there was no evidence that it was 
superior to them for delayed recall. 

8. There was no clear indication that either 
one of the two sound media was more effective 
than the other, for either immediate or de- 
layed recall. 

High 1.0. Group—tz. All four media were 
effective in the presentation of safety informa- 
tion for both immediate and delayed recall. 
Although there was some loss over the thirty- 
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day period, of the initial gains produced, 
nevertheless, all gains for both immediate and 
delayed recall were real and highly significant, 
as. shown by the high critical ratios obtained. 

2. The silent film slide produced the largest 
gain in test scores, for both immediate and 
delayed recall. 

3. The sound film slide ranked next for 
immediate recall, followed by the silent 
motion picture, but for delayed recall this 
order was reversed. 

4. For delayed recall, the difference be- 
tween the two silent media was slight, as was 
that between the two sound media. 

5. The sound motion picture produced the 
largest gain in test scores, for both immediate 
and delayed recall. 

6. The silent motion picture showed a sta- 
tistically reliable amount of superiority over 
both sound media, for immediate and for 
delayed recall. 

7. There was a strong but not absolutely 
reliable indication that the silent motion pic- 
ture was more effective than the silent film 
slide for delayed recall, but not for immediate 
recall. 

8. The silent film slide was clearly more 
effective than the two sound media for imme- 
diate recall, but the indications that it was 
superior to them for delayed recall, while fair, 
were not wholly reliable statistically. 

g. There was no clear evidence that either 
one of the sound media was superior to the 
other, in either instance. 

Low 1.0. Group—1. As was shown above 
for the other groups, here also all four media 
proved effective devices for the presentation 
of safety information, for both immediate 
and delayed recall. 

2. For immediate recall, the largest gain in 
test scores was produced by the silent motion 
picture, followed by the sound film slide and 
closely behind that by the silent film slide. 

3. The least gain for immediate recall was 
produced by the sound motion picture. 

4. For delayed recall, the picture was 
sharply altered from that given by the preced- 
ing 1.Q. groups. For the first time at any 
point in the data, the sound media recorded 
the production of a greater gain. The largest 
amount of gain was produced by the sound 
film slide, followed by the silent motion pic- 
ture and, almost equal with that, the sound 
motion picture. 
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5. No one medium showed any degree of 
superiority to the others that was statistically 
reliable. 

6. For immediate recall, the silent motion 
picture gave some indication of superiority to 
the two sound media, and somewhat less so to 
the silent film slide, but none of these indica- 
tions approached statistical significance. 

7. No reliable indications at all were ob- 
tained that there was any superiority of one 
to another, as between the silent film slide 
and the two sound media, or of the sound 
media with each other. 

8. For delayed recall, the findings were 
completely reversed. There was some indica- 
tion that the sound media may have greater 
effectiveness than the silent, particularly than 
the silent film slide. But none of these results 
approached closely to statistcal significance. 


Suitability of the Subject Matter—All 
Groups.—In presenting these conclusions, it 
must be noted that for each subject only one 
film was used, from which the other three 
forms of the media were prepared. Therefore, 
the following conclusions apply only to these 
four films and no others. No claim is made 
that the use of other materials on these sub- 
jects will produce the same results, and no 
general conclusions on comparative suitability 
of the different subjects will be made. But, 
since the materials of the four sets of media 
were considered fairly equivalent to each 
other, it was worth while considering whether 
any indications emerge that certain subjects 
are superior to others in suitability for visual 
presentation. 

1. All four subjects—automobile, bicycle, 
fire, and pedestrian safety—registered an 
effective gain when presented through visual 
media. 

2. There was some loss of information 
learned on each subject, over a thirty-day 
period, but all gains made on all subjects for 
both immediate and delayed recall were sig- 
nificant, as shown by the generally high criti- 
cal ratios. The subjects on which the greatest 
amount of gain in mean scores was produced, 
for both immediate and delayed recall, were 
fire and bicycle safety. 

3. The subject on which the least gain was 
produced for both immediate and delayed 
recall was pedestrian safety. 

4. The one subject which showed a clearly 
smaller degree of suitability for visual pre- 
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sentation than the other three was pedestrian 
safety, both on immediate and on delayed 
recall. 

5. There were some indications that fire 
safety and particularly bicycle safety were 
superior to automobile safety for immediate 
recall, but these differences were not entirely 
reliable statistically. 

6. For delayed recall, no such indications 
were evident at all. 

7. No reliable indications of any superi- 
ority as between bicycle and fire safety were 
given for either immediate or delayed recall. 

High 1.0. Group—1. As with the “all” 
grouping, all four subjects showed effective 
gains when presented through visual media. 

2. All gains recorded on all subjects were 
highly significant. 

3. On immediate recall, the largest gain 
was produced on bicycle safety followed by 
fire safety. However, all critical ratios were 
very high with small differences among them. 

4. For delayed recall, bicycle and fire 
safety were practically identical in size of 
gain produced, but greatly exceeded the other 
two subjects. 

5. On immediate recall, no clearly reliable 
indications of the superiority of one subject 
over another were found. Some indications 
did appear that pedestrian safety is less suit- 
able than the other three subjects. 

6. On delayed recall, there was a clear, re- 
liable indication that pedestrian safety was 
less suitable than fire and bicycle safety, and 
an indication that it may be less suitable than 
automobile safety. 

7. Both fire and bicycle safety gave very 
strong though not absolutely reliable evidence 
of superiority to automobile safety, but no 
indication of any difference between them- 
selves. 

Low 1.Q. Group.—t. For this group, as for 
the other two, presentation by means of visual 
media produced an effective gain for all four 
subjects. 

2. All gains made, for both immediate and 
delayed recall, were significant, except that 
for pedestrian safety on delayed recall. 

3. The subjects on which the greatest gains 
were produced, for both immediate and de- 
layed recall, were fire an bicycle safety. 

4. The least gain was produced in both in- 
stances on pedestrian safety. 

5. The one subject which showed a clearly 
smaller degree of suitability for visual pre- 
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sentation than the other three, for immediate 
recall, was pedestrian safety. On delayed re- 
call, it was also clearly inferior to fire and 
bicycle safety, but the indications were not 
as definite of its inferiority to automobile 
safety. 

6. There were some indications that fire 
and bicycle safety were more suitable than 
auto safety on delayed recall, but the data 
were not clearly reliable statistically. 

7. There were no indications of any supe- 
riority as between fire and bicycle safety on 
either immediate or delayed recall. 

Generalizations —A number of important 
generalizations, suggestions, and specific cri- 
teria emerge for the use of these media in 
safety education. 

1. The investigation offers additional re- 
search evidence that all the pictorial media 
aid materially in the learning process, for both 
immediate and delayed recall, and for groups 
of both high and low I.Q. 

2. The two comparatively “new’’ media, 
the sound and silent film slide, are effective 
visual tools that should receive the recogni- 
tion and the use which they merit. They com- 
pare favorably with the silent motion picture, 
and in all instances but one in this experiment 
were superior to the sound motion picture. 

3. The sound motion picture is the least 
effective of the media for achieving the type 
of result in safety education used as a measure 
in this experiment. Perhaps, because of the 
complexity of the device, the greater require- 
ments for its preparation and use, and the 
prestige and example of the commercial enter- 
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tainment film, it would appear that the sound 
motion picture has had an undue amount of 
emphasis placed upon it, and its value in the 
classroom has been too readily assumed. 
This is an important subject, and a careful 
measure of its effectiveness should be made, 
when criteria are used other than the increase 
in the pupil’s fund of information. 

4. The silent motion picture is the single 
most effective medium. The silent and sound 
film slide was very close behind. Therefore, 
it is advisable to consider certain factors 
other than effectiveness in presenting informa- 
tion that enter into the selection and use of a 
particular visual medium in the classroom. 

Costs of projector and film subjects are 
considerably higher for the motion-picture 
media than for the film-slide media. The 
film-slide projector is a much _ simpler 
machine, less bulky, less mechanically impos- 
ing, easier to operate, and therefore more 
readily accessible and consuming much less 
of the brief time of a classroom period than 
the motion-picture projector. 

These points serve to emphasize the advis- 
ability of giving more attention and recogni- 
tion to the film strip as a teaching tool, but 
they are not set forth to disparage in any way 
the merits of the silent motion picture. Its 
effectiveness is clearly established in this 
experiment. To the teacher or school official, 
however, these considerations of cost and use 
are highly important. They must determine 
whether the difference in learning produced 
warrants the use of the motion picture in 
spite of these other factors. 





CRITERIA FOR EVALUATING READING TEXTBOOKS 


Davip Kope.* 
Army of the United States 
and 
Joun F. O'Connor 
Army of the United States 


During the last decade teachers, admin- 
istrators, and research workers in the United 
States have begun to recognize that junior 
and senior high schools share with elemen- 
tary schools a definite responsibility for the 
improvement of reading. This realization has 
resulted in the development of courses in 
reading in many American secondary schools. 

Conceived first as emergency measures to 
help “poor readers” attain the reading skills 
needed to cope successfully with a high-school 
curriculum, these courses have been broad- 
ened in scope as their directors learned that 
the difficulties and needs of the “poor reader” 
differed only in degree from those of other 
children. The first courses were designated 
“remedial” and were devoted to the treatment 
of “reading disabilities”. Today in some 
schools provision is made in one or several 
courses for corrective and developmental, as 
well as remedial, reading. “Remedial’’ read- 
ing refers to the diagnostic and instructional 
procedures used with children seriously re- 
tarded in reading. “Corrective” reading is 
designed to aid children who display minor 
reading deficiencies. For all other pupils, 
whose present status is satisfactory, a pro- 
gram to promote growth in reading skills and 
interests —i.e., developmental reading — is 
provided." 

The introduction of reading courses has led 
to the preparation of specially designed text- 
books for children in Grades VII—XII. These 
materials reflect the new emphases and objec- 
tives in reading instruction at the secondary 
level that have just been cited. As the pro- 
duction and use of these books increase, they 
are destined to influence significantly the 
nature of reading instruction. It has appeared 
desirable to the present writers to attempt an 
appraisal of the books now available, which 
are listed in Table I. This task was soon 
found to predicate first the construction of a 


* On leave from Chicago Teachers College. 
1Cf. Guy L. Bond and Eva Bond, Developmental Reading 
in the High School. New York: Macmillan Co., 1941. 
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suitable evaluation technique. The present 
article describes the procedure followed in 
developing and formulating criteria for eval- 
uating the books listed in Table I (and simi- 
lar volumes). An accompanying article’ in 
this issue of the Journal discusses techniques 
that utilize these criteria in the evaluation of 
reading textbooks; some basic considerations 
in appraising the place of such material in 
reading instruction at the secondary-school 
level also will be proposed. 


PRELIMINARY CONSIDERATIONS 


To be useful, a technique for evaluating 
reading textbooks should help in answering 
the following question: How adequately does 
the program suggested in the textbook pro- 
vide for the development of appropriate read- 
ing skills and interests, and other desirable 
outcomes, in junior and senior high school 
pupils? This question raises one that is more 
fundamental: What are “appropriate reading 
skills and interests, and other desirable out- 
comes,” for adolescent children? The latter 
query (about curricular objectives) must be 
answered first. 

One valid approach to the formulation of 
educational objectives is through the study of 
the interests, abilities, and needs of the indi- 
viduals for whom a program is to be planned. 
Accordingly, appropriate aims for a reading 
course may be determined after investigating 
these characteristics of the boys and girls of 
representative pupil groups in the secondary 
school. This method, however, involves an 
ambitious undertaking far beyond the scope 
and resources of this investigation; therefore, 
it was rejected. 

Another possible procedure is to examine 
recent analyses of the needs and interests of 
secondary-school pupils, and to utilize the 
findings as a basis for building a list of aims 


2 David Kopel, “Procedures for Evaluating Textbooks in 
ge Journal of Experimental Education, X11 (Septem- 
ber, 1943). 
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TABLE I 
READING TEXTBOOKS FOR GRADES VII-XII 


Grade Publisher 


Level# 
9-12 


Title Author 
riments in Reading, 
, II, and Ill 
Hidden Treasures in ommend 
I, II, and IIT c 
Reading for Understanding. 
Following Printed Trails _- 
Flying the Printways.- - --.-.--..--- 
Reading for Skill 


McCall, Cook, Norvell Harcourt-Brace 


..McCall, Cook, Norvell. _ - Harcourt-Brace 
Appleton-Century 
- Heath 


Heath 


9-12 
9-12 
6-7 
7-8 


Noble and Noble 
Noble and Noble 
Little, Brown 
Little, Brown 
Harcourt, Brace 
McGraw-Hill 
Holt 


7-12 
4-8 
9-12 
7-10 
8-10 
9-12 
7-9 


Improving Your Reading -- - 
Read and Comprehend. 
Develop Your Reading -- 
Roads to Reading 
Self-Improvement in Reading 


Revamees H... .........- 


ion Keiebe . Jae . 
..Knight, Traxler 
Mack, McCall, Almack___- 
_.Pitkin, Newton, Langham 
..Roberts, Rand, Lundgren. - 
..Roberts, Rand, a 


Appy 8-10 Holt 


Let’s Read, ITI_- la 
Let’s Read, ks 
Reading in High Gear. : 


You and Your Reading 


Experiences in Reading and Thinking Center, Persons _ 
.Center, Persons - 


Practices in Reading and Thinking- - 
Problems in Reading and Thinking_..Center, Persons 


*The grade level shown is the one for which each book was 


: ~_ Roberts, Rand, Tardy-- 


age 
..Herzberg, Paine, Works 

Herzberg, Paine, Works __. 

a Paine, Works __. 


Holt 

Holt 

Harpers 
Houghton Mifflin 
Houghton Mifflin 
Houghton Mifflin 
Ginn 

Macmillan 
Macmillan 
Macmillan 


prepared, according to its 


- 911 

10-12 
9-12 
7-12 
7-12 
7-12 
7-12 
7-12 
7-12 
7-13 


author or publisher. It will be noted that a wider grade range of Bh coe is claimed for some 


books than for others. Those with narrow ranges, of one or two grades, are designed 


for use 


with poor readers at the specified levels; they may, however, be used as developmental texts 
with children in lower grades. Where a wide range of grades is shown for a volume, the intent 
is to cover both remedial and developmental needs—remedial in the upper and developmental 


in the lower levels of the specified grades 


Recent additions to the list above, published after this study was completed, are: Driving 


the 


Reading Road and Progress on Reading Roads, for grades 7 and 8 respectively (Chicago: 


Lyons and Carnahan). 


for reading instruction. Although some excel- 
lent research is being done in the field of chil- 
dren’s interests, this alternative, also, was re- 
jected; in this case because the results suffer 
from various limitations: 


The reported investigations of children’s 
tastes and interests up to the present can 
not be accepted at their face value. At best, 
they have disclosed only broad average 
trends in the preferences of somewhat nar- 
rowly selected groups. Moreover, they have 
been concerned mainly with the compiling 
of choices under different conditions, sel- 
dom under conditions of adequate expo- 
sure to wide varieties of reading materials 

. Moreover, many of the studies have 
been so loosely controlled that the results 


probably do not indicate the free choices 
of the groups studied. Adequate techniques 
for determining such choices have not been 
discovered.* 


A third method is to reduce the goals of 
various functioning programs in secondary- 
school reading to a composite list of com- 
monly accepted objectives. These programs 
are presumably based, to some degree at 
least, on the needs and interests of adolescent 
boys and girls. This last procedure, compre- 
hending elements of the others, was adopted 
as most feasible. 


“Jean Betzner and R. L. Lyman, “The Development of 
Reading Interests and Tastes,” The Teaching of Reading, 
p. 189. Thirty-Sixth Yearbook of the National Society for the 
Study of Education, Part I. Bloomington, Illinois: Public 
School Publishing Company. 1937. 
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THE OBJECTIVES OF READING PROGRAMS IN 
THE SECONDARY SCHOOL 


A survey was undertaken of secondary- 
school reading-course objectives; these were 
derived from the aims suggested prominently 
in the textbooks themselves and in recent 
articles and books by such writers in the field 
of secondary-school reading instruction as 
Cross, Deals and Seamans, Eberhart, McCal- 
lister, Monroe, Paton and Pierce, Pooley, 
Powell, Roberts, Smith, Strang, Witty and 
Kopel, and Wrightstone. The consensus of 
opinion among these writers is that reading 
instruction should result in pupil improve- 
ment or growth in: 


. Comprehension 
. Vocabulary 
. Work-study skills 
. Library skills 
. Skill in reading for various purposes 
. Skill in reading different kinds of 
materials 
. Speed of reading 
8. Efficiency of eye-movements 
9. Oral reading ability 
to. Tendency to read extensively 
tt. Familiarity with many areas of reading 
12. Interest in books 
13. Depth and number of worthwhile 
interests 
14. Broadness of experience 
15. Socially desirable attitudes 
16. Adjustment and behavior 
17. Oral and written expression 
18. Ability to appreciate good writing and 
to distinguish between good and poor 
books 
19. Tendency to read critically 


The foregoing items, of course, are not 
distinct and separate entities; they merely ex- 
press different facets of a dynamic matrix of 
good reading habits, skills, attitudes, and in- 
terests that comprise true competence in 
reading. The objectives suggested by this in- 
ventory were then organized and arranged as 
a preliminary checklist for evaluating text- 
books in reading. 

The next step was to restate these objec- 
tives in a form suitable for use as criteria. 
Thus, the objective of “improvement in com- 
prehension” (No. 1) becomes, in criterion 
form, “provision for the development of com- 
prehension.” Many of the objectives were 
converted into criteria as easily as in the 
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instance cited. In another instance, however. 
the objectives listed as “3” and “4” wer 
considered to be very closely related and not 
deserving of the heavy weight they would 
receive by treatment as separate criteria; 
both objectives were therefore included in th 
wording of one criterion. 

Considerable liberty was taken with the 
reformulation of some of the other objectives, 
in order to achieve what the writers believe 
to be a consistent and comprehensive set of 
criteria. For example, the achievement of 
greater “efficiency of eye-movements” (No. 
8) was not believed to be an intrinsically 
valid objective;* however, some notice of this 
aim is appropriate and was incorporated in 
one criterion concerned with “provision for 
the correction of faulty reading habits.” In 
another case the general and rather vague 
objective of “improvement in adjustment and 
behavior” (No. 16) was given more explicit 
and significant current meaning by conver- 
sion into the criterion of “emphasis on read- 
ing for democratic action.” Some of the cri- 
teria, it should be noted, were derived from 
more than one objective. Several criteria 
were added that had no direct counterparts 
in the objectives; they express obviously 
necessary considerations in judging the tech- 
nical construction of textbooks in reading. 

The foregoing procedure yielded a check- 
list of twenty-five criteria; each is discussed 
individually below. The numbers in paren- 
theses after each criterion are the numbers 
of the objectives to which the criterion is 
most closely related. The annotations are 
primarily syntheses of views expressed by 
various authors from whose work the criteria 
were derived. The writers have introduced, 
however, additional emphases of their own 
and of other contributors to the literature 
that seemed necessary to a description of a 
well-rounded and vital program of reading 
instruction.* 


THE CRITERIA 


1. Provision for development of compre- 
hension in reading (No. 1).—‘“Comprehen- 
sion” refers here to skill and facility in 

® Considerable evidence has been adduced to show 
eye-movement patterns reflect —¥ a } 
improve without the benefit of any fic remedial attention 
as oe panel ame sills = 
and David Kopel, ucative Process, 
seins, Boston: cine y > ow 1999. 

The writers wish to acknowledge their indebtedness and 
appreciation to Professor Holland a of Stanford Uni- 
versity, who read the manuscript and whose valuable sug- 
gestions have been incorporated in several parts of the paper. 
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responding appropriately to printed symbols. 
Growth in this ability—a function in part of 
mental maturation and experience—is deter- 
mined to an important degree by guidance or 
education. A reading textbook should nurture 
the development of this ability by frequent 
emphasis upon reading for meaning, and by 
illustrating the dependence of meaning upon 
context.” 

Reading needs to be portrayed to children 
as a discriminative, selective process involv- 
ing interaction between the reader and the 
writer through the medium of print. The con- 
tinuity of reading and living should be shown 
by pointing out how the reader’s background 
of experience influences his interpretations of 
print, and that the fruition of reading is to be 
found in modified attitudes and in action 
(directed, in a democratic society, toward the 
achievement of socially desirable human 
values).* (Cf. criterion No. 24.) Highly de- 
sirable and useful is the interpretation of 
reading as simply an indispensable, special- 
ized form of the interpretative or discrimina- 
tive process that characterizes intelligent 
behavior. 

By conveying the foregoing and other in- 
sights about the reading process, a textbook 
may aid the child in understanding how he 
reads, and thereby help him inestimably in 
understanding what he reads. The various 
desired outcomes of reading instruction set 
forth in many of the following paragraphs 
may be considered subsidiary or closely re- 
lated to this over-all objective of fostering 
competence in reading with understanding. 

2. Provision for development of critical 
reading (No. 19).—A_ reading textbook 
should seek to dispel the notion that facts or 
ideas are necessarily accurate or correct 
simply because they appear on the printed 
page. It should promote a critical attitude 
and a healthy skepticism toward advertising 
claims and the editorializing indulged in by 
partisan newspapers. It should develop this 
habit of evaluation in connection with all 
reading materials, historical as well as con- 
temporary. In short, it should foster the 
tendency to question, criticize, and evaluate 
the implicit as well as expressed assumptions 
in reading materials; and it should encourage 
the constant practice of checking statements 


*John B. Kerfoot, How to Read. Boston: Houghton Mifflin 
Co., 1916; S. I. Hayakawa, Language in Action. New York: 
Harcourt Brace & Co., 1941. 

*Holland Roberts, “English for United Action,’ Elemen- 
tary English Review, XIX (May, 1942), 177. 
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by facts. The good reader “not only senses 
what is between the lines but searches back 
of the words to find the purpose and watch 
the effects.’”° 

3. Provision for vocabulary growth (No. 
2).—This criterion refers to opportunities 
within the reading selections: for the acqui- 
sition of new words, for engaging in word 
study and etymological exercises, and for in- 
struction in the use of the dictionary and 
thesaurus. 

4. Provision for development of skill in 
reading for various purposes (No. 5).—A 
good general overview of the topic of pur- 
poses in reading is given by W. S. Gray, who 
mentions fourteen purposes that “have been 
emphasized repeatedly in recent reports and 
investigations.”"? The question implied in this 
criterion is: To what extent does the text- 
book emphasize and implement the idea that 
there are many purposes for reading, and that 
the reading techniques employed should be 
consonant with one’s purposes? 

5. Provision for development of skill in 
reading different kinds of materials (No. 6). 
—tThis criterion calls attention to the degree 
of diversity found in the selections with re- 
spect to length, literary form, and range of 
subjects. Here one must judge not only 
whether the textbook contains different kinds 
of materials, but also whether it provides 
suggestions and exercises for developing skill 
in reading these varied materials. 

6. Provision for development of speed in 
reading (No. 7).—Suggested by this criterion 
are such questions as: To what extent does 
the textbook emphasize the importance of 
speed in reading? How well does it support 
that emphasis with speed tests, and similar 
devices? Does it stress that speed of reading 
is not a constant, but is or should be modi- 
fied by one’s reading purposes and by the 
nature of the materials being read? This 
point of view finds delightful expression in a 
statement by Clifton Fadiman: 


I do not believe dogmatically either in 
fast or slow reading. I believe tripe should 
be read practically with the speed of light 
and, let us say, Toynbee’s A Study of 


®Cf. Edgar Dale, How to Read a Newspaper. Chicago: 
Scott, Foresman and Co., 1941. 

% Holland Roberts, “Reading for Personal and Social 
Action,” Elementary English Review, XIX (April, 1942), 152. 

1 W. S. Gray, Editor, The Testers of Reading. ’ 
35. ——- Yearbook of the N.S.S.E., Part I. Bloom- 
ington, Illinois: Public School Publishing Co., 1937. 
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History with tortoise deliberation. And 
most books are nearer to tripe than they 
are to Toynbee. But the trouble with prac- 
tically all of us is that we suffer from 
chronic reverence. We make. the unwar- 
ranted assumption that because a man is in 
print he has something to say, and, acting 
on this assumption, we read his every word 
with scrupulous care. This may be good 
manners, but it’s a confounded waste of 
time.** 


7. Provision for improvement of oral 
reading (No. 9).—This criterion suggests 
that a textbook should designate or include 
appropriate selections to be read aloud; that 
it should emphasize the desirability of making 
use of every classroom opportunity and other 
natural audience situations to improve oral 
reading ability; and that it should foster 
development of habits of accurate pronuncia- 
tion, clear enunciation, and proper phrasing. 

8. Provision for development of work-study 
and library skills (Nos. 3 and 4).—To study 
effectively, high-school pupils must possess 
the ability to read printed discourse critically 
and in a manner appropriate to their purpose 
and to the nature of the material (see criteria 
I, 2, 4, 5, and 6). Needed also by these chil- 
dren are the somewhat technical information 
and skill involved in reading efficiently such 
non-discoursive materials as maps, tables, 
charts, graphs, tables of contents, indexes, 
menus, etc. Desirable likewise is facility in 
the use of card catalogues, magazine indexes, 
encyclopedias, and other distinctively library 
and reference materials. In addition, it is 
important to cultivate good study habits such 
as budgeting time and formulating work 
objectives. Improvement in the foregoing 
special study skills becomes perforce a logical 
part of the educational program presented in 
reading textbooks. 

9. Simplicity of vocabulary and language 
structure.—The usefulness of a reading text- 
book is enhanced, if it can be read profitably 
by both “good” and “poor” readers of a 
given age or grade. This feature is present 
when the selections contain challenging, 


relatively mature ideas, and are written in 
simple language and readable style. (Cf. 
criteria 10 and rr.) 

10. Interestingness of materials —Inter- 


estingness,” a general quality difficult to 


™ Clifton Fadiman, ane = Liked, pp. xiii-ziiii. 
New York: Simon and Schuster, 1941. 
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define or measure, encompasses such factors 
as diversity and contemporaneity of topics; 
exciting, adventurous, and significant themes; 
freshness of treatment; and relevance to the 
problems and concerns of children in the 
junior and senior high school grades. 

11. Gradation in difficulty of reading 
materials.—The importance of this criterion 
derives from the truism that one: learns to 
read by reading, and from its corollary that 
growth in reading ability parallels the read- 
ing of increasingly difficult, challenging mate. 
rial. However, the new, more difficult maite- 
rial must not be so much more taxing than 
the content to which the reader is accus- 
tomed that he becomes frustrated and dis- 
couraged. 

Implicit in this criterion, therefore, is the 
requirement that a series of books should in- 
crease in difficulty from volume to volume, 
and that individual volumes should advance 
in difficulty as one progresses from beginning 
to end. Unfortunately, all of the objective 
methods for grading the difficulty of reading 
material are too unreliable and cumbersome 
to be very useful.** One must depend upon 
subjective estimates, the validity of which 
depends primarily upon a wide familiarity § 
with books and children’s reactions to them. 

12. Organization according to areas of in- 
terest—Continuity in the reading selections 
of a text contributes to their readability and 
increases the likelihood that they will be 
read, if the pupil is interested in the general 
area represented. This criterion refers, there- 
fore, to the grouping of selections according 
to the interest areas in which they belong; 
books are penalized when topically related 
selections are not arranged in some logical 
order or are found only at random intervals. 

13. Balance between “work-type” and 
“recreatory” materials (Nos. 5, 6, 11).—The 
word “balance,” as used here, is not meant 
to denote any definite mathematical relation- 
ship between the somewhat different types of 
reading mentioned, but serves to emphasize 
the desirability of substantial representation 
in each category. The writers recognize that 
the commonly expressed dichotomy between 
“work-type” and “recreatory” material is 
nonetheless arbitrary and even fictional when 
based solely upon the structural character- 
istics of the material. Whether Ge ee 

Elliott, “A. Critical Analysis o Objec: 
Oma 
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of a given book or selection is “work” or 
“play” depends as a rule much more upon 
one’s attitude, purpose, and skill than upon 
any “intrinsic” qualities of the book. The 
criterion calls attention then to the use of 
(r) materials that involve or consist of ex- 
ercises, assignments, and other traditional 
school tasks, and (2) materials predominantly 
narrative or descriptive in character, and 
easy to read. 

14. Balance between classical and contem- 
porary materials, and among the different 
literary forms (Nos. 5, 6, 10, 11).—In this 
criterion, as in the one directly above, “bal- 
ance” refers only to a fairly good representa- 
tion of each of the types of materials indi- 
cated. It is desirable that a text introduce 
children to reading that is varied with re- 
spect to time, people, and problems, as well 
as to many styles of treatment and literary 
forms.** 

15. Amplitude of materials (Nos. 10, 11). 
—While bulk in itself is obviously no virtue 
in a book, a small volume can not contain 
the many types of selections and exercises 
desired in a reading textbook. Amplitude of 
interesting, informative, worthwhile material 
is therefore important. 

16. Attractiveness of format.—‘Format” 
may be interpreted to include such factors as 
general appearance, size, weight, illustrations, 
covers, margins, type, paper, and ease of 
handling. These physical characteristics of a 
book determine in some measure whether a 
volume will be selected voluntarily and read 
with a pleasant “set” by a child. Since poor 
readers so often dislike books and reading, 
books designed for their use must look as 
attractive and easy to read as possible, yet 
withal avoid a juvenile or childish appearance. 

17. Adequacy of pupil and teacher aids.— 
The textual characteristics included in this 
classification are: word lists, glossaries, ques- 
tions, charts, drills, diagnostic tests, indices, 
keys, topical reading lists, manuals, and pro- 
fessional bibliographies.*® These aids should 
be appraised for their usefulness and ade- 
quacy. 

18. Provision for correction of faulty read- 
ing habits (No. 8).—Faulty reading habits 
are indicative of a retarded or immature 


“Cf. Lou LaBrant, An Evaluation of the Free-Reading in 
Grades 10, 11, and 12. Contributions to Education, Vol. 1, 
No. 2. Columbus, Ohio: Ohio State University Press, 1936. 

Ivan R. Waterman and Irving R. Melbo, “A Plan of 
Procedure for the Evaluation of Textbooks in Reading,” 
Elementary School Journal, XXXV (May. 1935), 670-671. 
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status in reading. In other words, they are 
associated with or are symptomatic of poor 
reading. However, the perseveration of these 
habits acts in a vicious circle to aggravate a 
youngster’s reading difficulties and to make 
them progressively worse. Fortunately, most 
poor reading habits, such as are reflected in 
faulty eye-movement patterns, improve as the 
child reads highly motivated and well chosen 
materials. Nevertheless, many undesirable 
habits may properly and effectively be cor- 
rected simply by describing them, by point- 
ing out how they interfere with the achieve- 
ment of meaning, and by providing the simple 
admonitions and exercises that help to over- 
come them. Included in this category of 
faulty habits are: excessive vocalization, lip 
movements, pointing, and head movements; 
substitutions, insertions, omissions, repeti- 
tions, and guesses in word perception; and 
mechanical word-calling and improper phras- 
ing." 

19. Stimulation of desire to be a good 
reader (No. 12).—The introductions to prac- 
tically all textbooks—and, in some volumes, 
additional sections—extol the values of read- 
ing. These materials attempt to stimulate an 
appreciation of the significant role played by 
reading in modern society, and of the cor- 
relative need for the individual to know how 
to utilize wisely this instrument of communi- 
cation and medium of expression. The value 
of reading to the individual as an agency for 
enriching his personal life and for enhancing 
his usefulness to others should be stressed. 
On a lower level, added incentive for becom- 
ing a good reader is found in some texts in 
the provision of charts, tests, and other de- 
vices for ascertaining and recording growth 
in reading abilities. 

20. Stimulation of extensive reading (Nos. 
6, 10, 11).—This criterion calls attention to 
the desirability of encouraging pupils to read 
widely in many books and periodicals, and 
to read in relation to their interests and 
problems. Suggestions for supplementary 
reading and annotated book lists are helpful 
devices for implementing this objective. 

21. Stimulation of oral and written expres- 
sion (No. 17).—The arts of verbal communi- 
cation—reading, writing, speaking, and lis- 
tening—are closely interrelated and comple- 
mentary. Common to all is much of the psy- 


% For a more detailed statement of ay reading habits 
and of methods for their elimination, see Paul Witty and 
David Kopel, op. cit., Chs. 7 and 8. 





32 JOURNAL OF EXPERIMENTAL EDUCATION 


chological process called thinking. Genuine 
improvement in one of these related language 
areas influences beneficially the status of the 
others, except where physical impediments 
interfere. Encouragement of meaningful, 
well-organized, purposeful oral and written 
expression is therefore desirable in a reading 
textbook as a means of fostering growth in 
intelligent reading. 

22. Stimulation of growth in reading tastes 
(No. 18).—The kind of development desired 
in terms of this criterion can not be obtained 
in any substantial degree through a direct 
approach. Indeed, the common practice of 
telling children what is “good” and “poor” 
literature is best calculated to foster artificial 
standards and meretricious tastes. It is far 
more educative to encourage children to seek 
books that are “good” for them. If genuine 
growth is to be engendered, a child must have 
a series of successful reading experiences, in 
which he selects materials in relation to his 
interests and in terms of their contribution to 
his understandings and purposes. 

23. Emphasis on the development of desir- 
able social attitudes (No. 15)—Like the 
English course in which, as a rule, they are 
designed to be used, reading textbooks 
attempt to inculcate social attitudes and 
behavior traits that are commonly deemed 
“desirable.” Among those frequently men- 
tioned in the literature are: tolerance, sym- 
pathy, loyalty, respect for authority, obe- 
dience, thrift, persistence, patriotism, and 
unselfishness. 

The attempt to indoctrinate attitudes and 
traits such as the foregoing is acceptable in 
a textbook, provided there is recognition that 
the terms used are abstractions to be inter- 
preted not as absolutes, but as variables in 
relation to the situations or contexts in which 
they occur. For example, when respect for 
authority is preached without qualification 
and, if it is practiced blindly, without con- 
sideration of the sources of the power vested 
in authority and of its objectives, the conse- 
quence may be undignified, demoralizing 
subservience and acceptance of evil. In some 
situations disrespect for authority can be vir- 
tuous. Of course, experience and common 
sense usually correct the over-simplifications 
and unsound generalizations conveyed by a 
literal reading of much moralistic material. 

The effectiveness of such material depends 
largely upon the form it takes. Since preach- 


[Vol. 12, No.2 


ing is resented by most children, didactic and 
hortatory treatments should be avoided in 
favor of vicarious experiences that stimulate 
the reader to identify himself with laudable 
characters and discriminative, responsible 
conduct. 

24. Emphasis on reading for democratic 
action (No. 16).—Even when part of the 
school day is set aside for specialized instruc- 
tion in reading, teachers must not lose sight 
of their ongoing responsibility, transcending 
the demands of any “subject,” to develop 
competent citizens for a democratic society. 
Our assumption is that primarily boys and 
girls must learn in school to live together har- 
moniously and to work together effectively 
in achieving socially desirable goals. Another 
premise is that children will lead the kinds 
of lives they learned to live as children. If 
their school curriculum is to equip them with 
the social attitudes and intellectual abilities 
necessary for a high level of cooperative social 
life, children (and teachers) at every level 
must be free to plan and to carry on challeng- 
ing activities that represent direct participa- 
tion in the work of making this a better 
world. 

The fundamental objective of reading in- 
struction, and indeed of education generally, 
has been stated with great clarity and con- 
viction by Holland Roberts in a forthright 
and provocative editorial: 


Every reading act should fit into the 
pattern of our effort to improve the wel- 
fare of the people of the United States. 
The test of reading is not understanding of 
printed symbols, but action. The aim of 
the teaching of reading is good food, cloth- 
ing, shelter, health, and work and recrea- 
tion and the cultural enrichment of our 
people. If the reading program results in 
understanding about nutrition but does not 
improve the nourishment of our underfed 
millions, then it has failed the only impor- 
tant test. The well-being of the people is 
the final measure.** 


25. Encouragement of participation in 
various non-reading activities and experiences 
(Nos. 13, 14).—The encouragement of chil- 
dren’s participation in worthy non-reading 
activities serves to equip them with the mean- 
ings and purposes necessary to engage suc- 

Holland Roberts, “Ri for Personal and Social 
Action,” Blementary' English Review, XIX (April, 1942), 
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cessfully in many types of reading. Such par- 
ticipation also provides vital motivation for 
reading that is integrated with living. 

Guidance in this area is clearly a legitimate 
function of a reading program. Suggestions 
for and descriptions of socially constructive 
activities in which children can engage have 
a very important place in a reading textbook ; 
they are especially pertinent if they stimulate 
related reading. Such suggestions provide the 
implementation for the emphasis set forth in 
the preceding section.** The value of a read- 
ing textbook may be measured roughly by its 
adequacy in fostering an interdependent pro- 
gram of useful living and reading. 


SUMMARY 


Reading textbooks for Grades VII to XII 
represent a rather important and unique pub- 
lishing venture of the last decade. Their pro- 
duction reflects the commendable new interest 
of teachers and school officials to improve the 
reading ability of adolescent boys and girls. 
The extensive and increasing use of these 


1% For many valuable tions, see L. Rosenblatt. Litera- 
ture as Exploration. New York: D. Appleton—Century Co., 
1938 
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materials led the present writers to seek a 
procedure for evaluating their merits. A wide 
sample of the literature on reading at the 
secondary level was examined to obtain ex- 
pert opinions as to the objectives of reading 
instruction. Some nineteen different aims 
were found to be rather commonly expressed. 
Statements of these aims were converted into 
a form suitable for use in evaluating the in- 
structional program in reading textbooks. 
Other items were added to provide standards 
for gauging the typographical and structural 
adequacy of the textual materials. The re- 
sulting formulations numbered twenty-five. 
When read with their annotations, they are 
offered as a set of criteria for judging the 
merits of reading textbooks. The criteria 
and their annotations may be read also as a 
statement of the emphases and provisions 
that the writers believe should characterize 
the whole reading program in the upper ele- 
mentary and secondary grades. 

Another article will discuss two evaluational 
methods which utilize these criteria, as well 
as suggest certain other considerations that 
should govern the selection and employment 
of reading textbooks. 





PROCEDURES FOR EVALUATING TEXTBOOKS IN READING 


Davip Kopet* 
Army of the United States 


Elsewhere is described the method em- 
ployed in obtaining a set of criteria for the 
evaluation of reading textbooks.’ Twenty- 
five criteria ‘were formulated to represent 
desirable qualities in reading textbooks (and 
in reading programs). These criteria are as 
follows: 

1. Provision for development of compre- 
hension in reading. 

. Provision for development of critical 
reading. 

. Provision for vocabulary growth. 

. Provision for development of skill in 
reading for various purposes. 

. Provision for development of skill in 
reading different kinds of materials. 

. Provision for development of speed in 
reading. 

. Provision for improvement of oral 
reading. 


8. Provision for development of work- 
study and library skills. 

9. Simplicity of vocabulary and language 
structure. 

10. Interestingness of selections. 


11. Gradation 
materials. 

12. Organization according to areas of 
interest. 

13. Balance between “work-type” 
“recreatory” materials. 

14. Balance between classical and contem- 
porary materials and among the dif- 
ferent literary forms. 

15. Amplitude of materials. 

16. Attractiveness of format. 

17. Adequacy of pupil and teacher aids. 

18. Provision for correction of faulty read- 
ing habits. 

19. Stimulation of desire to be a good 
reader. 

20. Stimulation of extensive reading. 

21. Stimulation of oral and written expres- 
sion. 

22. Stimulation of growth in reading tastes. 

: David Kopel aad John F. O'Connor, “Criteria for Evalu- 


ating Reading Text ’ Journal of Experimental Education, 
XII (September, 1943). Pp. 26-33. 


in difficulty of reading 


and 


23. Emphasis on the development of desir- 
able social attitudes. 

24. Emphasis on reading for democratic 
action. 

25. Encouragement of participation in 
various non-reading activities and ex- 
periences. 

Examination of the foregoing list will indi- 
cate to most readers, perhaps, the general 
nature of the emphasis and bias of the cri- 
teria. Each criterion, however, contains 
terms such as “a good reader”, terms sus- 
ceptible to many diverse definitions. The 
meaning of some criteria can be demon- 
strated only through illustrations. For these 
reasons the writer urges any one seriously 
interested in the criteria to read them with 
their annotations in the accompanying article 
in the current issue of the Journal. This is 
imperative, if the criteria are to be applied 
with understanding in any evaluative pro- 
cedure. 


SUBJECTIVE EVALUATION 


It is suggested in the companion article 
that a reading textbook is “ ” to the de- 
gree that it possesses the qualities enumerated 
in the foregoing check list (and defined in 
the accompanying annotations of the preced- 
ing article). The criteria call attention to 
characteristics of a text that are significant 
in judging its merits. Given an understand- 
ing of the various items in the check-list, and 
with the list in mind or before her, a teacher 
can readily make an informed assay of any 
reading textbook, as well as a comparison of 
several volumes. It is thus possible to deter- 
mine with some specificity whether a text is 
relatively good, bad, or indifferent as a whole, 
and in its various parts. 


QUANTITATIVE EVALUATION 
The foregoing procedure lends itself quite 
well to the evaluation of one or a few texts. 
It proves inadequate, however, when one is 
confronted with the task of making a com- 
parative evaluation of any considerable num- 
ber of books. In this situation a quantitative 
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procedure appears to be needed. Therefore, 
a rating device known as a scorecard was 
constructed. 

Since there were twenty-five criteria, it was 
easy to use round numbers. Thus, rooo points 
were made available for scoring a text that 
would completely satisfy all criteria. Each 
criterion was accorded an equal value, or 40 
points. This arrangement facilitated appraisal 
of each of the twenty-five textual character- 
istics on a five-step scale: 40 points to be 
awarded if the text were excellent in the 
required characteristic, 30 points if it were 
good, 20 points if it were fair, ro points if it 
were poor, and no points at all if it were en- 
tirely lacking in the required characteristics.* 
(The five 10 point steps permitted further 
subdivision if finer gradations were desired.) 

A scorecard such as has been described 
was used in rating all the texts listed in 
Table I of the accompanying article.* Total 
scores for the various books ranged from 360 
to 920 points.* Only three books, all single 
volumes, received less than 600 points each. 
The other texts, which included seven series 
of from two to six volumes, all received rather 
high total scores, in most cases between 700 
and goo points. These results indicate that 
most of the books possess a high degree of 
merit and potential usefulness. 

Considerable variation, however, was 
found to exist among the books with respect 
to their excellence in meeting the standards 
suggested by the individual criteria. For ex- 
ample, of two books that obtained total scores 

2No doubt it can be argued that some criteria are more 
important than others, and should be weighted commensur- 
ately. However, a ical and valid method for determining 
Proper weights not suggest itself. Moreover, the writer 
reasoned (or rationalized) that whatever inequalities exist in 
the twenty-five items would lama / cancel each other in the 

of the total scorecard. ff this is incor- 


application 
rect, the total scores obtained will distort the true numerical 
value of certain texts, exaggerating some 

others. This danger provides another reason, in 

those pointed out later in the discussion, for using total 
scores with great caution. 

*It should be noted that reading textbook series (which 

in number from two to six volumes) were considered 
sing.e units for rating purposes. 

* Ratings were made first by John F. O’Connor, a graduate 
student working under the writer’s direction. Ratings of the 
same books by the writer ided somewhat different results. 
Such discrepancies are to expected, of course. However. 
they lead the writer to refrain from publishing detailed scores 
until they can be validated by obtaining and pooling the 
ratings of a number of qualified judges. Any interested 
teacher, school official, or chologist. not employed by a 
publishing house or associa with the preparation of 
volumes listed in Table I, is invited to cooperate in this 
project. Upon receipt of an inquiry the writer will furnish 
such persons with scorecard directions for rating the 
reading textbooks. Judges must furnish their own books and 
they must agree to read all of the books carefully before 
rating them. The ratings received during a three-month 
— be averaged and the data, if substantial, will be 
Publis b 
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of about 800 points, one received o points on 
“provision for development of critical read- 
ing,” while the other received 40 points. 
Although such extreme variations in quality 
in any one characteristic were uncommon in 
books having high total ratings, this illustra- 
tion does show the danger inherent in using 
only the total ratings for evaluation purposes. 


OTHER CONSIDERATIONS IN EVALUATING 
TEXTBOOKS 


It is clear that the total scores derived 
from applying the scorecard to the reading 
textbooks should not be considered absolute 
measures of their merits. Of greater signifi- 
cance in determining the value of a text for 
a given group of children are the ratings of 
the book on each criterion or characteristic. 
Moreover, each book and each characteristic 
of every book should be evaluated in terms 
of its usefulness for a specific child, ie., in 
terms of the relevance of the materials to the 
interests and needs of the individual. Such 
considerations may lead to the selection of a 
book that ranks low on the scorecard; never- 
theless, it may be the best book for a par- 
ticular youngster at a given time. Children’s 
needs thus become the paramount considera- 
tions in selecting reading textbooks for them. 
Moreover, since the children in any class will 
display diverse interests and needs, a teacher 
will rarely meet these needs by using any 
single volume as a class text; she will do far 
better to regard these special volumes as 
manuals or reference books to be used only 
at appropriate times by children whose spe- 
cial needs they meet. 


A desirable procedure is to inventory the 
needs of a group and then to select as many 
(or more) books as there are children in the 
group; the books will be chosen finally in 
terms of their correlation with children’s 
needs. Frequently one finds small groups 
within a class with more or less common 
problems; for them one provides a dozen 
copies of one title, seven or eight of another, 
and perhaps half a dozen of a third book. 
For the remaining individuals one purchases 
single copies, thus extending the variety and 
range of materials available to the whole 
class. A typical library in a reading class- 
room would then include at least one vol- 
ume of nearly all of the available books. The 
purchase of additional copies of any book 
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would be determined by the evaluation pro- 
cedures and consideration of children’s needs 
as described. 


Tue Pace or TEXTS IN A READING 
PROGRAM 


Although this report implies and, indeed, 
stresses the value of texts, it should not be 
inferred necessarily from this discussion that 
reading textbooks constitute the only or 
even the most significant component of a 
sound reading program. Experts hold some- 
what divergent views as to the proper role of 
textbooks in classroom instruction. For ex- 
ample, Strang suggests certain values in their 
use: 


For gifted well-prepared teachers with 
extensive library facilities practice books 
are unnecessary, for they can plan with 
each pupil individually a valuable progres- 
sion of reading experiences. For overbur- 
dened teachers with little background in 
the theory and procedures of reading in- 
struction, the practice books provide sug- 
gestions and materials which they can use 


to good advantages.° 


Witty, on the other hand, questions “the 
desirability of recommending a basic text, 
the use of which will undoubtedly bring about 
some improvement in present conditions.” 
He believes that: “It is doubtful whether 
such a recommendation (were it to be fol- 
lowed) would represent a forward and bene- 
ficial step”.* His reasons are: 


. . « Genuine and enduring improvement 
in reading will occur, . . . only in so far as 
teachers become expert in studying and un- 
derstanding children and in directing and 
guiding them so that worthy individual pat- 
terns of growth in reading will develop. 
Teachers, therefore, must become serious 
and competent students of children’s 
growth; and in addition, they must acquire 
thorough acquaintance with children’s liter- 
ature, old and new. There are more produc- 
tive ways of teaching reading than by use of 
a text; free-reading programs and experience 
curriculums have abundantly demonstrated 


5 Ruth Strang, Problems in the Improvement of Reading 
in High School and College, p. 282. Lancaster, Pennsylvania: 
Science Press Printing Co., 1938. 

*Paul A. Witty, “A Review of Growth in Reading,” 
English Journal, TII (May, 1939), 407. 
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this. One citation only, Lou LaBrant’s An 
Evaluation of a Free Reading Program, is 
evidence enough. The issue here is patently 
clear: Are we, as teachers, interested pre- 
dominantly in a body of subject matter 
which all children will study; or are we 
concerned primarily with other objectives, 
viz., the preservation of individuality, per- 
sonality orientation and adjustment, and 
continuous sturdy growth. A position on 
this question will determine our interest in 
and use of basic texts.’ 


It should be noted that Witty argues 
against the use of such books as we have been 
discussing as basic texts. In other words, he 
opposes a mechanical, inflexible reading pro- 
gram that is oriented with primary reference 
to a prescribed series of exercises contained 
in some practice book. With this position the 
present writer concurs, but holding to this 
position does not, in the writer’s opinion, pre- 
clude the proper use of reading textbooks. 
Expressed earlier was the view that: (1) not 
one basic text, but several texts should be 
employed in a typical class; (2) these books 
should be selected and used only in so far as | 
they relate to definitely ascertained children’s 
needs; (3) reading textbooks should be re- 
garded not as “basic texts”, but rather as 
reference books, manuals, workbooks, etc.:; 
and (4) they should be considered to consti- 
tute one element only in a_ well-rounded, 
abundant classroom library of diversified 
reading materials. 

No single book is a substitute for a rich 
library and for a teacher who understands 
children and books, and how to bring them 
together. With this limitation of texts thor- 
oughly understood, teachers in Grades VII- 
XII need have no reluctance in providing a 
place for many reading textbooks in their 
developmental, corrective, and _ remedial! 
reading classes. Even in free-reading pro- 
grams and experience curriculums, some chil- 
dren will probably continue, at least in the 
immediate future, to display reading defi- 
cienies that may be corrected in part through 
judicious use of selected materials from read- 
ing textbooks. For some years to come, there- 
fore, the reading textbook seems destined to 
provide a valuable supplement to other essen- 
tial facilities of a sound reading program. 

* Loc. cit. 





READING REACTIONS FOR VARIED TYPES 
OF SUBJECT MATTER 


An Analytical Study of the Eye Movements of Eighth Grade Pupils’ 


Eart WILLIAM SEIBERT 
Guidance Director and Psychologist 
Belleville Schools, New Jersey 


THE PROBLEM AND Its IMPORTANCE 


The purpose of this study was two-fold: 
(1) to determine the nature of the eye move- 
ments of eighth-grade pupils while reading 
different types of subject matter and to 
identify relationships that may exist between 
eye movements and various types of subject 
matter during the reading process, and (2) to 
determine the effect that various parts of a 
selection have on eye movements as subjects 
progress through a 300 word reading selection. 

Reading problems hold a prominent place 
in the minds of present-day educators. 
Various methods have been used to analyze 
problems of reading difficulty. One of these 
has been the study of photographic records 
of the eye movements of individuals while 
they are reading. It has been established that 
efficiency in reading is reflected in oculomotor 
behavior. 

Early investigators in the field of oculo- 
motor behavior were concerned primarily 
with what their studies of eye movements 
would reveal about the reading process. 
Their studies dealt with few subjects. How- 
ever, beginning in 1917, investigators became 
more concerned about the individual differ- 
ences to be found in the records of eye move- 
ments. New developments made it possible 
to secure longer records from each subject 
and to use more individuals. It was found 
that there were varied and complex patterns 
of eye movements among individual subjects. 
The individual varies his eye movements to 
meet the particular reading situation at hand. 
Eye-movement habits are flexible and appear 
to adjust readily to any change in the per- 
ceptual processes involved. 

Recent investigators have shown the need 
for additional research in eye movements 
when the individual reads different types of 
subject matter and when he reads longer 

1 Abstract of a study submitted in partial fulfillment of the 

{ Philosophy 


He ere for the of Doctor of in 
Se of Education of New York University, 1943. 


selections than have customarily been used 
in eye-movement investigations. There is 
also the need for intensive studies of the eye- 
movement habits of individuals at a particular 
age level. No intensive study of the eye 
movements of eighth-grade boys and girls has 
been reported. 

The present investigation is a study of the 
eye movements of sixty eighth-grade boys 
and girls while reading various types of sub- 
ject matter. The selections of subject matter 
are academic material of average eighth-grade 
level. These selections are 300 words in 
length and have been equated on the basis 
of vocabulary difficulty and of number and 
length of sentences. 


EXPERIMENTAL PROCEDURE 


Eighth-grade pupils in the public schools 
of Belleville, New Jersey, cooperated as sub- 
jects in the experiment. Belleville school 
pupils are typical of the boys and girls of the 
nation in their performance on certain objec- 
tive tests. The thirty-one boys and twenty- 
nine girls selected as subjects are a repre- 
sentative sample of the eighth-grade pupils 
in Belleville. 

The photography of eye movements was 
done in January and February of 1942 by the 
investigator, who is guidance director and 
psychologist for the board of education, 
Belleville, New Jersey. 

Paragraph selections were taken from aca- 
demic material of six different types: (1) 
mathematics, (2) biography, (3) adventure, 
(4) physical science, (5) history, and (6) 
geography. Juries of New York University 
professors or comparable public-school leaders 
selected typical eighth-grade subject matter 
for each of the six types. Each selection was 
300 words in length. The six selections 
finally accepted were comparable in number 
and length of sentences and in vocabulary 
difficulty. 
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The selections were printed on non-glare 
index cards in 10-point type. The length of 
the lines was 3.5 inches and two-point leading 
was used between the lines. 

The Ophthalm-O-Graph, a portable binoc- 
ular eye-movement camera, was used for 
photographing the eye movements as the sub- 
ject read the material from a card attached 
to the instrument. A standard uniform pro- 
cedure was used in giving the directions to 
the subjects throughout the tests. Each sub- 
ject read an orientation selection of fifty 
words before beginning the reading of the 
longer selections. Two selections were admin- 
istered at each setting with at least one day 
intervening between sittings. 

A comprehension test of from fourteen to 
twenty-four questions was prepared for each 
selection. These questions were answered by 
the subject immediately after the reading of 
each selection. The subject was told before 
reading the selection that he would be asked 
to answer questions on it. The validity of 
each test item was established before the 
items were used in this experiment, in a pre- 
liminary study conducted by the investigator 
with the 135 pupils in the eighth grade of 
Derry Township public schools, Hershey, 
Pennsylvania. The Hershey and Belleville 
eighth-grade pupils were comparable. Only 
significant items were used in the scoring of 
the comprehension tests. 


RESULTS 


The purpose of the first phase of this 
study was to determine the nature of the eye 
movements of eighth-grade pupils while read- 
ing different types of subject matter and to 
identify relationships that may exist between 
eye movements and various types of subject 
matter during the reading process. 

The mean number of fixations per 100 
words was found for the sixty subjects on 
each of the six types of subject matter. The 
reliability of the difference in the number of 
fixations required to read 100 words was com- 
puted between the various selections. The 
number of regressions per 1oo words, the 
average duration of fixation (in seconds), the 
average span of recognition (in words), the 
rate of reading in words per minute, and the 
comprehension scores were given the same 
statistical treatment. Critical ratios are 
shown in Table I. 
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The range within each measure and fo 
each selection was found. To show the varia. 
tion with which the same individual read the 
different selections, standard deviations were 
computed for the performance of each indi- 
vidual on all selections. This was done for 
each eye-movement measure. 


The average comprehension score of the 
individual for the six ions was cor- 
related with the language part of the Cali- 
fornia Test of Mental Maturity and with the 
average for each of the five eye-movement 
measures. The various eye-movement meas- 
ures were correlated with each other. The 
average comprehension score for all the sub- 
jects in Belleville was with the 
average comprehension score for all of the 


Hershey subjects. 


Significant differences on all the five eye- 
movement measures are evident in Table I. 
The differences are greater for comprehension 
than they are for any of the five eye-move- 
ment measures. The differences in the type 
of selection seem to have more effect on the 
comprehension of the selection than they 
have on the eye movements used during the 
comprehension of the selection. 


There are variations in the eye-movement 
measures when the same individual reads 
different selections. There are individuals 
who read all the selections with approximately 
the same number of fixations; with other in- 
dividuals the difference in the selection is 
accompanied by a difference in the number 
of fixations. The same is true of regressions, 
of span of recognition, and of rate of reading. 
In each case there were individuals who read 
all the selections with variation in that par- 
ticular eye-movement measure, but there 
were also many subjects who read all the 
selections with little variation in that par- 
ticular eye-movement measure. This was not 
true of duration of fixation; there is little 
variation in the duration of fixation a subject 
uses when reading the different selections. 


There is little relationship between com- 
prehension scores and eye-movement meas- 
ures. Number of fixations, number of regres- 
sions, duration of fixation, span of recogni- 
tion, or rate of reading can not be predicted 
on the basis of the scores in comprehension. 
Reading comprehension and eye-movement 
measures are two different phases of the 
complex process of reading. 
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When investigations are made of eye move- 
ments, as much attention should be given to 
the construction of adequate tests to measure 
the comprehension of the material read as is 
granted to the securing of an accurate photo- 
graphic film record. 

The photography of eye movements does 
not need to create an unnatural reading situa- 
tion for the subject. If proper rapport is 
established, pupils can be expected to give a 
valid record of their reading habits. 

Means on the six measures are shown in 
Table II for each of the different selections. 

The group means for all of the selections 
on each of the eye-movement measures were: 
fixations, 127.00 + 3.19 per 100 words; re- 
gressions, 29.58 + 1.21 per 100 words; dura- 
tion of fixation, .2837 + .00331 seconds; 
span of recognition, .837 + .0214 words; 
and rate of reading, 182.93 + 5.91 words per 
minute. 

The purpose of the second phase of this 
study was to determine the nature of the eye 
movements of the subjects in reading various 
parts of a 300 word selection. 

The mean number of fixations per 100 
words, based on the averages of all the sub- 
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jects on all the selections, was found for the 
first fifty words, the first hundred words, the 
second hundred words, the third hundred 
words, and the entire 300 words. The relia- 
bility of the differences in average number 
of fixations between each of the parts of a 
300 word selection was computed. The relia- 
bility of the difference between the number 
of fixations for the first fifty words and the 
first hundred words was computed for each 
selection. This was also done for the first 
hundred words and the second hundred 
words, and for the second hundred words and 
the third hundred words. 

The same statistical treatment was given 
to the data of the number of regressions per 
roo words, the average duration of fixation 
(in seconds), the average span of recognition 
(in words), and the rate of reading in words 
per minute. 

When the means for each of the five parts 
of a selection are based on all the six selec- 
tions, there is a trend in the direction of 
greater efficiency of eye movements during 
the reading of the third hundred words than 
during the reading of any other part of a 300 
word selection. The next greatest efficiency 


TABLE II 


MEANS ON SIx MEASURES 


FOR DIFFERENT SELECTIONS 


Selections 


Fixations 
(per hundred 
words) 


Regressions 
(per hundred 
words) 


Duration of 
Fixation 
(in seconds) 


Span of 
Recognition 


(in words) 


Rate of 
Readin 
(words per 
minute) 


Comprehension 
(per cent) 


Cc 
129. 83 
3. 67 
28. 42 
2. 59 


Ie 
12. 
1 


177. 50 
6. 43 
49. 80 
4.53 
34. 89 
2.73 


21.17 
1.93 
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of eye-movement measures takes place dur- 
ing the reading of the first fifty words. (See 
Table IIT). 


The rate of efficiency of eye-movement 
measures established during the reading of 
the first fifty words is decreased during the 
reading of the second fifty words; the reader 
re-orients himself during the second hundred 
words and finally attains his greatest effi- 
ciency of eye-movement measures during the 
reading of the third hundred words. This is 
true when the data are based on the reading 
of all the selections. 


When the data are considered on the basis 
of individual selections, there is greater effi- 
ciency of eye-movement measures during the 
first fifty words than during the first hun- 
dred words. There are no significant differ- 
ences in the efficiency with which the first 
hundred and second hundred words are read. 
There is greater efficiency during the third 
hundred words than during the second hun- 
dred words when the data are considered for 
individual selections. 


Therefore, whether the data are computed 
in terms of all the six selections or in terms 
of each individual selection, the pattern of 
eye movements of eighth-grade pupils during 
the reading of a 300 word selection is the 
same; the rate of efficiency of eye-movement 
measures established during the reading of 
the first fifty words is decreased during the 
reading of the second fifty words; the reader 
re-orients himself during the second hundred 
words and finally attains his greatest effi- 
ciency of eye-movement measures during the 
reading of the third hundred words (Table 
IV). 

CONCLUSIONS 


1. There are significant differences for 
each of the five eye-movement measures in 
the reading of selections of different types of 
subject matter. 
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2. The differences between selections are 
greater for comprehension than they are for 
any of the eye-movement measures. 

3. There are variations in eye-movement 
measures for individual subjects, as well as 
for groups of subjects. 

4. There is little relationship between com- 
prehension scores and eye-movement meas- 
ures; this is to be expected, for both are 
different phases of the complex process of 
reading. 

5. Both an eye-movement film record and 
an adequate test of comprehension on the 
material read are important parts of a read- 
ing examination. 

6. If proper rapport is established, pupils 
can be expected to give a valid eye-movement 
film record of their reading habits. 

7. The first fifty words of a 300 word 
selection give a fair sample of the eye move- 
ments of eighth-grade individuals, but a more 
accurate picture of the pattern of eye-move- 
ment measures is provided by the film record 
of the third hundred words. 


IMPLICATIONS OF FINDINGS 


1. Each subject teacher in the eighth grade 
needs to be a teacher of reading. 

2. Some eighth-grade pupils maintain a J 
definite pattern of eye-movement habits in 
the reading of different types of subject mat- 
ter, but most eighth-grade pupils vary their 
eye-movement habits when reading selections 
of different types. 

3- Possibilities for the increasing of the 
span of recognition and for the training of 
other eye-movement habits need to be ex- 
plored at various age levels. 

4. The teaching of vocabulary and em- 
phasis on techniques of getting the thought 
from the printed page should aid the reading 
comprehension of the pupils and therefore 
play a part in the improvement of the read- 
ing process. 


TABLE IV 
THE VARIOUS MEANS BASED ON ALL THE SELECTIONS 


Ist 50 


. 128.50 
30. 50 
. 2770 


ee —--~=------- 
pan of recognition 
Benen pet... ..........---- 


Ist 100 


129. 33 
31. 50 
. 2823 
. 815 833 
182. 08 


2nd 100 3rd 100 


Entire 
300 


124.17 
27. 58 
. 2847 
865 


187.91 


127.00 per 100 
29.58 words 
. 28387 seconds 
. 887 words 
182. 93 


126. 33 
29. 58 
. 2870 


184.17 
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5. If an individual pupil has desirable eye- 
movement habits but inadequate comprehen- 
sion, emphasis on vocabulary and the tech- 
niques of getting thought from the printed 
page may aid in the improvement of the 
reading process. 

6. If an individual pupil reads with good 
comprehension, but has undesirable eye- 
movement habits, it is possible that develop- 
ment of more desirable eye-movement habits 
may aid in the improvement of the reading 
process. 

7. A film record of a fifty-word selection 
will give a fair picture of the eye-movement 
habits of an individual. A film record of a 
fifty-word selection in each of several types 
of subject matter will indicate the extent to 
which an individual pupil varies and adjusts 
his eye-movement habits to meet the demands 
of a different selection. When a very com- 
plete picture of the reading habits of an indi- 
vidual is required, a 300 word selection in 
each of several types of subject matter will 
need to be read with eye-movement photog- 
raphy being done on the third hundred 


words. 
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THE PLOT-COMPLETION TEST 


For Use in High Schools by Guidance Counselors, School Psychiatrists, 
and Teachers of Literature* 


SARAH I. Roopy 


PURPOSE OF THE TEST 


This test was constructed for the purpose 
of analyzing the pupil’s attitude toward ficti- 
tious situations and, indirectly by implica- 
tion, toward his own life problems. It fur- 
nishes a crude measurement of certain specific 
abilities: first, to grasp all the facts in a given 
situation; second, to evaluate suggested solu- 
tions in the light of the given facts and the 
pupil’s knowledge of life as gained from ex- 
perience and observation; and, third, to 
select a true-to-life solution. In general, it 
yields interesting implications as to whether 
the pupil’s approach to life problems is scien- 
tific and well integrated. Such an analysis of 
the pupils’ reactions will be useful to school 
psychiatrists, psychologists, guidance coun- 
selors, home room teachers, and all other per- 
sons interested in the personality develop- 
ment of school children. It will also give 
considerable assistance to the teacher of 
literature, for it will not only help him to 
understand the members of his class, but will 
also enable him to proceed with greater in- 
sight in guiding their reading and interpre- 
tation of literature. 

Some attitudes that may warp the pupil’s 
thinking about literature and about life are 
morbidity, wishful thinking in its various 
forms, and superstition. The test is designed 
to reveal such tendencies on the part of per- 
sons answering the questions. 


DESCRIPTION OF THE TEST 


The Plot-Completion Test presents ten 
“plot germs”, or situations involving conflict. 
For each plot five endings are listed, which 
the pupil is asked to number in the order of 
their probability as outcomes of the given 
situation. The most true-to-life ending is to 
be labeled 1, the one next in probability 2, 
and so on. If the pupil completes the test 
before the close of the class period, he is 
asked to go back through the plots and star 
for each one the ending that he thinks would 


* Developed as part of a doctorate dissertation completed 
at New York University, 1943. 


make the best story, irrespective of whether 
it is true to life or not. Pupils who still have 
time after doing this are asked to check thus 
(VV) for each plot the ending that describes 
the most advisable course of action. (These 
additional responses, included partly to en- 
gage the attention of quick workers who are 
likely to grow restless before their classmates 
finish the test, are also interesting as indica- 
tions of whether the pupil recognizes the fact 
that the ending he prefers may not be the 
one most likely to occur.) 

Some specific attitudes that may prevent 
the pupil’s proper evaluation of the solutions 
are: (1) the desire for a happy ending, even 
if it necessitates a lucky accident, a sudden 
and unwarranted change in character, or a 
violation of the laws of nature; (2) the desire 
to reward the likable person and punish the 
less amiable one, regardless of who is in the 
right in the given situation; (3) a morbid 
preference for an unhappy outcome, even 
when a cheerful one is more probable; (4) a 
tendency to reject the given problem and sub- 
stitute an easier one; and (5) a superstitious 
willingness to credit mystical mental powers 
and other unscientific beliefs. These five 
attitudes are significant indications of the 
pupil’s personality and of his taste in reading. 
The maker of the test included them because 
she had been noticing for several years the 
frequency with which they appeared in orig- 
inal short stories and plays written by mem- 
bers of her English classes and in their com- 
ments about their reading. She had observed 
also that certain types of classroom behavior 
seemed to parallel these attitudes toward fic- 
titious situations. The test is designed to re- 
veal these attitudes where they exist to a 
marked degree. Since a person may think 
emotionally about some problems encountered 
in fiction and objectively about others, ac- 
cording to the degree of their relevancy to 
his own case, each plot in the test is based 
upon an event that might conceivably happen 
to the pupil; and the situations are planned 
to include relationships involving parent and 
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child, teacher and pupil, friends of the same 
sex, and friends of the opposite sex, in order 
to cover a sufficiently wide range to reveal 
the pupil’s emotional bias, if he has a very 
marked one. 


It is granted that some pupils whose re- 
actions to their own life situations are affected 
by such attitudes as the test is meant to re- 
veal may not evidence these attitudes in com- 
pleting the plots, because the test is pre- 
sented as an intellectual task and the prob- 
lems are therefore artificial. It is easier to 
solve another person’s problems than one’s 
own, and still easier to solve hypothetical 
than real ones, for in these cases one’s point 
of view is more objective. Despite this fact, 
it frequently happens that the pupil identifies 
himself with some of the characters in the 
plots, particularly if his thinking is habitually 
colored by his emotions. Moreover, the very 
fact that the test is presented to the pupil 
as a measurement of literary ability, rather 
than as a personality questionnaire, some- 
what lessens the wariness of the sophisticated 
taker of personality tests. In testing approxi- 
mately 400 high school seniors the maker of 
this test has found relatively few whose an- 
swers gave no evidence of any of the atti- 
tudes that the test is meant to disclose. 


How THE PLot-CoMPLETION TEST 
Was DEVELOPED 


Before the final version of the test was 
reached, two successive preliminary forms 
were tried out on various groups of high 
school seniors in Rockland County, New 
York. A large number of high school teach- 
ers, graduate students in the School of Edu- 
cation of New York University, psycholog- 
ical experts, and miscellaneous adults also 
took the tests. Everyone who answered the 
questions was invited to comment on them. 
The comments guided the maker of the test 
in revising it. While these comments revealed 
certain weaknesses in the early forms of the 
test, they also confirmed the examiner in her 
impression that a form could be developed 
that would achieve her purpose. When the 
shortcomings revealed by this preliminary 
investigation had been eliminated, the exam- 
iner deleted all questions on which no pupil 
had made any mistakes and all those on which 
all pupils had made mistakes, and rearranged 
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the remaining ones in order of their difficulty, 
The Plot-Completion Test is the final form 
resulting from the investigation. 


Tue Scortnc Key 


The scoring key was based upon the judg- 
ment of ten psychological specialists, who 
ranked the endings for each plot in order of 
their probability. They submitted their an- 
swers individually, without comparing notes, 
To serve as a check against the answers of 
the ten experts, ten members of the English 
Education Department in the School of Edv- 
cation of New York University, 25 student 
nurses at the University of Portland, and 18 
miscellaneous educated adults chosen at ran- 
dom from the acquaintances of the examiner 
took the test. Their answers and those of 
253 Rockland County high school seniors 
were tabulated and compared with those of 
the ten specialists. The specialists’ scoring 
key was corroborated by the consensus of all 


Credits were assigned for answers in such 
a way as to indicate as accurately as possible 
every gradation in discrimination between 
realistic and unrealistic thinking. 


RELIABILITY 


In order to measure the reliability of the 
test, the examiner correlated the odd and 
even scores of the 319 Rockland County high 
school pupils who had up to that time taken 
the test. By the split-half method it was 
learned that the coefficient of reliability of 
half the test is .7168. Using the Spearman- 
Brown formula, the examiner found that the 
coefficient of reliability of the entire test is 
.8350. The index of reliability was found to 
be .9138. In other words, merely temporary 
circumstances have comparatively little effect 
upon the score of a pupil taking this test, and 
the score he obtains is very likely to be the 
true measure of his ability in the areas being 
tested. 

VALIDITY 


Since the index of reliability of a test is a 
measure of its theoretical validity, the Plot- 
Completion Test is clearly a valid criterion 
of that which it directly tests—the pupil’s 
ability to predict the outcomes of situations, 
avoiding certain pitfalls offered by appeals 
to wishful thinking and by other tricks fre- 
quently employed in pseudo-realistic fiction. 
Evidence that the test fulfills this purpose is 
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also present in the comments of the ten psy- 
chological experts who served as judges for 
the test. 

A further check on the usefulness of the 
test in revealing the pupil’s success or failure 
in detecting the specified falsities in plot was 
furnished by an analysis of a set of original 
short stories written by a group of high school 
pupils who also took the Plot-Completion 
Test. In order to compare the implications 
of the short stories with those of the test 
answers, the examiner selected from the 
stories all those containing marked instances 
of the falsities in plot that the test is meant 
to measure. Each of these stories (18 in 
number) was analyzed in comparison with 
the same pupil’s test paper. The purpose of 
the comparison was to ascertain whether the 
pupils who had written unrealistic stories had 
also received low scores in the test, and 
whether the same types of errors had been 
made by each pupil in both of his papers. 
A marked similarity appeared in the two 
papers of 12 of the 18 pupils. In five other 
cases there was a general similarity, and in 
only one case was there no similarity at all. 

For the reasons — above, it may be 
assumed that the Plot-Completion Test has 
validity in measuring ability to discriminate 
between realistic and pseudo-realistic plots. 
Whether it also gauges validly a pupil’s ad- 
justment to life is quite another matter. There- 
fore, the examiner correlated the scores of 91 
students on Victor Noll’s What Do You 
Think? A Test in Scientific Thinking’ with 
their scores on the Plot-Completion Test. The 


1 Victor H. Noll, What Do You Think? A Test of Scien- 
tiie Thinking. New York: Bureau of Publications, Teachers 
College, Columbia University, 1935. The test is accompanied 

handbook for teachers, called The Habit of Scientific 
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coefficient of correlation was found to be be- 
tween .14 and .78 on the one percent level of 
certainty. For predicting scores of individuals 
from one test to the other, this degree of cor- 
relation would be too low, but it is a depend- 
able indication that some correlation exists 
between the two tests. Therefore, since the 
validity of Noll’s test has been established,” 
it is reasonable to conclude that a pupil’s 
answers to the Plot-Completion Test may 
yield some valuable implications as to his 
approach to life problems. More than that 
this examiner does not claim for her test. She 
believes that even this amount of help in 
diagnosing individual personalities will be 
useful. 
Uses oF THE Ptot-CoMPLETION TEST 


Because of its reliability and validity, this 
test may be used for diagnostic purposes and 
to measure the improvement made by classes 
in their ability to detect some of the tricks 
of pseudo-realism. Such information would 
be of service to both the teacher of literature 
and the guidance counselor. 

The examiner believes that her test is even 
more useful as a teaching device than as a 
measure of improvement. Pupils who have 
taken the test are always eager to discuss it, 
and such discussion may be made very 
fruitful. It offers a specific starting point for 
simple lessons in mental hygiene. It may also 
motivate instruction on the differences be- 
tween books that present a true picture of 
life and those which only purport to do so. 


2 As evidence of the validity of his test, Noll has shown 
that the scores are little ive intelli 
that the separate items of the test 
making high total 
test, and that this discrimina- 
pages 23-25 
of the handbook. 





INFLUENCE OF STUDENT DREADS UPON ATTITUDES 
TOWARD SCHOOL SUBJECTS 


Winona M. Perry 
University of Nebraska 


What are the attitudes or feelings that 
accompany the early achievement of pupils 
who have entered a class either with antici- 
pation, or with dread lest they be unable to 
cope with its subject matter? Will such like, 
indifference, or dislike: (1) persist through- 
out their study of this course, and (2) de- 
velop into a strong desire to have the oppor- 
tunity to study more widely or more inten- 
sively in this field? 

These questions, together with the findings 
of previous experimental attacks upon this 
problem, were incorporated into subject ques- 
tionnaires, one for each subject studied on 
the high school or the college level. During 
1940-41 these questionnaires were presented 
to students in the University of Nebraska en- 
rolled in introductory courses in educational 
psychology and in high school methods. In 
general, these students, as will be observed in 
Tables Ia, Ib, and Ic, were university soph- 
omores or juniors (84%) whose experiences 
on the high school level occurred mainly in 
small or large city schools (52%) or in town 
or consolidated schools (47%). Ninety-eight 
percent of these students stated that the aver- 
age evaluation of their scholastic achievement 
in high school was a mark of A or B, but that 
in college their present status would be de- 
scribed more nearly by a mark of B or C. 

The frequencies of the three categories of 
students who liked, or were indifferent to- 
ward, or disliked a given subject revealed that 
the proportions of students in each category 
were similar, whether the students had 


1 For one of the groups that included 124 students, ratings 
on the A.C.E. Psychological Examination (1940 Edition) 
were available. Eighty of these students (64%) earned 
ratings that indicated student ability to reach at least a B 
or C achievement level in college. ( Table Id.) 


studied in one of the larger or smaller high 
schools, were then upper or lower classmen, 
possessed a psychological rating of B or C, 
or had achieved a scholastic level of B or C. 
Thus, no one of these factors could be re- 
garded as a major cause in developing student 
attitudes of liking or indifference toward or 
dislike of a given subject. Consequently the 
investigator turned to a critical examination 
of another contributing factor—the influence 
of dreading or not dreading one’s experiences 
in a subject area before starting to study 
that subject. 

Sources of data were the responses of stu- 
dents to sixteen subject-questionnaires. Of 
these, nine pertained to subjects that these 
students had studied while in high school, 
and seven to college subjects which they had 
studied or were studying at that time. Sum- 
maries of these data appear in Figures I and 
II. The legend, which describes the frequency 
totals of answers to the several questions as 
tabulated for English composition, will guide 
the reading of each frequency tabulation for 
any subject studied in high school (English, 
American history, world history, algebra, 
geometry, foreign languages, general science, 
biology, and chemistry) or in college (Eng- 
lish composition, English literature, American 
history, foreign languages, biology, chemistry, 
and geography). Although the total number 
of students was 225, the maximum number of 
responses to any one item on any subject- 
questionnaire was 221. 


SuBJEcTs DREADED, OR Not DREADED 


The order in which subjects on both high 
school and college levels were dreaded is: 





High School Subject? 


General science ___ _ ___-- 


Biol 
World hi 
American history 


Frequency of Dread 


College Subject? 
6% English literature 


2 See Table II regarding percentages of students reporting in each subject. 
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High School Subject* 


Algebra. 
Foreign Languages 


22% | 
23% § 


31%) 
35% § 


Frequency of Dread 


Average 


More often 


STUDENT DREADS 


College Subject? 
English composition 
American history 
Foreign languages 
Geography 


Biology 


Most often 


Therefore, among these sixteen subjects 
investigated, college chemistry holds a unique 
position, in that it is the one subject which 
was dreaded by more than fifty percent of its 
students. Geometry and chemistry in high 
school join with biology and chemistry in 
college in being those subjects that students 
regard with the greatest degree of apprehen- 
sion. While, at the other extreme, English in 
high school and English literature in college 
emerge as those subjects that students ap- 
proach, not with hesitation, but with a more 
positive attitude of anticipating their experi- 
ences in these fields.* 

The statement of reasons for dreading or 
not dreading to study these subjects, it will 
be noted from Figures I and II, have much 


both the nature of the subject matter and the 
teacher seem to be about equally effective 
causes of attitudes toward geometry, foreign 
languages, biology, and chemistry (S2T> 
Y); (2) but those students who had dreaded 
to study algebra and geometry regard their 
own inability as the cause more frequently 
than the teacher (S>Y>T). 


ATTITUDE TowARD SUBJECTS 


What are some of the concomitant atti- 
tudes accompanying achievement in these 
school subjects? Will certain subjects attract 
and others repel our students? The findings 
of Table IVa, derived from data presented in 
Figures I and II and in Table III, may be 
summarized thus: 





Students 
All 
“Not dreads” 
“Dreads” 


Exceptions 
Foreign languages, geography (college) 


Biology, chemistry, Eng. comp. (college) 





smaller frequencies, owing to the fact that all 
students were urged to state their reasons 
only when known, and according to a given 
classification, with or without elaboration by 
illustration or explanation. However, in gen- 
eral, the most potent reason for dreading or 
not dreading a subject is the nature of its 
subject matter. For all high school subjects 
except mathematics, the teacher is the greater, 
or approximately equal, cause for dreading 
or not dreading a subject than is one’s esti- 
mate of his ability, the pattern being S(Sub- 
ject) >T (Teacher) >Y(Yourself); but, for 
college subjects, this finding is reversed, since 
one’s self is stated as the cause more, or as 
frequently, than is the teacher (S>Y2T). 
There are two exceptions to this general 
trend and each appears on the high school 
level: (1) among the “not-dreads” students, 


*An attempt was made to discover whether the fact that 
a subject is required or elective in a curriculum, or whether 
the number of semesters which had been devoted to its study. 
would be indicative of the frequency of dread of that subject. 
The data, however, show that as yet neither fact is pre- 
dictive of the position which a subject will occupy on this 
“scale of frequency of dread’. 


In general, when students had completed a 
semester of study in these subjects, their 
liking for these subjects far outweighed their 
attitudes of indifference or of dislike, although 
these latter attitudes occurred with approxi- 
mately equal frequency in two college courses, 
foreign languages and geography. However, 
although this conclusion remains true among 
the “not-dreads”, those students who had 
dreaded these subjects had, on the whole, 
developed dislike of them more frequently 
than either liking of or indifference toward 
them. But, among the “dreads”, on the col- 
lege level, dislike, indifference, and like ap- 
peared in biology and chemistry, and in part 
in English composition, with about equal 
frequency; while on the high school level, 
frequency of student dislike of geometry out- 
numbered that of like and of indifference by 
a ratio of two to one, and their dislike of 
foreign languages occurred twice as often as 
did that of indifference, and four times that 
of like. 





JOURNAL OF EXPERIMENTAL EDUCATION [Vol. 12, No.1 


Figure I* 
HicH ScHoot SUBJEcTs 


ENGLISH STATUS: DESIRE TO ELECT 
7 Not Final Another Course 


Dr. Dr. L I D 


3 147 13 0 Yes... 181 


of Study ° 
8 30 ss ae . ee ee 

1 

5 


7 


: 7 0 1 8 No... 82 


2, 3, 4, Total 194 15 155 35 4 Intensity 


REASONS: Those who had (or Like, Indifference, or Dislike 
had not) dreaded to Persistin; a Changi Sapent Course 
start studying it: From From D 
Not Not Not Not 


Dr. Dr. Dr. q Dr. Dr. a Dr. 


S(Subject) 7 Q 0 0 
T(Teacher) 6 6 2 2 
Y (Yourself) . - -- 5 1 2 0 


HISTORY: Not STATUS: DESIRE TO ELECT 


AMERICAN . Dr Not Final Another Course 


Dr. Dr. L I D Not 


Dr. Dr. 
$ms¢4 383 0 Yes... 86 9 


1 Ind... 34 5 


Semesters 131 
sina toed ; = : 8 5 221 5 


2 30 
1 5 Total 160 86 129 10 25 11 15 Intensity 63 17 


REASONS: Those who had (or Like, Indifference, or Dislike 
had not) dreaded to es or Changing throughout a 
start studying it: From L From I From D 
Not Not Not 


Dr. L 4 Dr. b Dr. 


S(Subject) 27 7 1 
T (Teacher) 6 1 
Y (Yourself) _ _ .- 1 0 


4 
0 

3 1 3 24 i: 6429 2 ws 2 21 
6 


DESIRE TO ELECT 
Another Course 


D Not 
Dr. Dr. 


8 °. 2 po ae 
19 2 2 Ind... 28 3 
0 8 6 No... 3 16 

8 


Total cH 8 8 Intensity 51 


REASONS: Ba po y ~- af or 7 Like, ~y.— ~ ._— Ce 
ad not) drea to —— or ughout Course 
start studying it: From wee I From D 
Not Not Not 
Dr. Dr. b : 3 Dr. Dr. 
S(Subject)..... 17 17 13 5 0 
11 6 7 1 2 
Y (Yourself) _ _ _- 4 5 1 0 1 
* See end of Figure II for explanatory note on how to read this Figure. 


Final 
I 


18 
4 





STUDENT DREADS 


FicgurRE I—Continued 
HicH ScHooL SUBJECTS 


STATUS: 


Not 
Dr. 


L 127 
I 26 
99 D 2 
5 Total 155 


Those who had (or 
had not) dreaded to 
start studying it: 

Not 


Not STATUS: 
Dr. r. 
85 53 

6 


37 


Not 

Dr. Dr. 
2 1 
5 3 

110 54 
8 8 


Those who had (or 
had not) dreaded to 
start studying it: 

Not 


Dr. Dr. 


§(Subject) 15 48 
T(Teacher) 16 15 
Y(Yourself) _ _ __ 3 20 


REASONS: 


STATUS: 


Not 
Dr. 


LANGUAGES: 


Not 
FOREIGN Dr. 
ired_ 


148 


Those who had (or 
had not) dreaded to 
start studying it: 

Not 


Dr. 


8(Subject) ; 30 
T(Teacher) 12 
Y(Yourself)__ __ 10 


REASONS: 


DESIRE TO ELECT 
‘ Another Course 
Final 


Dr. L I D Not 
Dr. Dp. 


9 108 712 0 7 ee LA 
es £6 te? 2 -€¢ ee. oo 5 
Se 1%+6 £3 2. ea Bee 
45 114 14 32 14 9 17 Intensity 63 15 


Like, Indifference, or Dislike 


ros | or Ch throughout Course 
a - From D 
ot 
Dr. Dr. Dr. 
4 
2 
0 


DESIRE TO ELECT 
Another Course 


D Not 
Dr. Dr. 


mm. & 6 


Final 
I 


, 4 e@ 6 4 

6 0 2 9 3 2 {nd... 21 5 

47 0 10 1 7 4 80 No... 6 6&2 
65 83 17 27 16 13 82 Intensity 45 28 
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Persisting or C | area Course 
From L From D 
Not 
Dr. Dr. 
3 22 
2 11 
0 3 


DESIRE TO ELECT 
Another Course 


Not 
Dr. Dr. 


3 11 x ae 
3 4 £4: 2 = 
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7 


27 11 14 27 Intensity 70 


Like, Indifference, or Dislike 
Persisting or eee | wee Course 
From L From D 

Not 

Dr. Dr. 
2 15 
2 6 

0 1 
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FigurE I—Continued 
HicH ScHOOL SUBJECTs 


STATUS: 


Not 
Dr. 


L 69 
I 29 
D 2 
100 


ae 
0 
10 


28 3 Total 


Those who had (or 


Dr. 


DESIRE TO ELE¢? 
Another Course 


Not 
Dr. Dr 


Yes__. 2 


Final 
I 


0 6 0 

1 20 2 Ind. _- 
. i 
22 & 6 Intensity 
Like, Indifference, or Dislike 


had not) dreaded to ——- anes Sapepat Course 
From m I 


From D 


S(Subject) 
T (Teacher) 
Y (Yourself) _ _ -- 


BIOLOGY 
Requi 
Elective 

Semesters 

of Study 
4 
3 


2 
1 


start studying it: 
Not 


Dr. 


STATUS: 


Not 
Dr. 


68 . 


Dr. ee 
1 : 14 
1 0 
71 
13 


Those who had (or 
had not) dreaded to 
start studying it: 

Not 


REASONS: 


S(Subject) 
T(Teacher)__-_-_- 
Y(Yourself)_ __. 


CHEMISTRY 
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4 


3 
2 
1 


Dr. Dr. 


17 9 
16 3 
8 2 


Not 
Dr. 
1l 
28 


Not 
Dr. Dr. 
0 1 
1 1 
40 16 
2 1 


STATUS: 
Not 
Dr. 
L 28 
I 13 
D 2 
Total 43 


Those who had (or 
had not) dreaded to 
start studying it: 
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Dr. 
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T (Teacher) 3 
Y (Yourself). _.. 6 
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Not 
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Dr. Dr. Dr. Dr. Dr. 
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REASONS: 


§(Subject) 
T(Teacher)----.- 
Y(Yourself). ..- 


ENGLISH LIT- 
ERATURE 


Semesters 
of Study 
5,6 
8, 4 
9 


1 
REASONS: 


S(Subject) 
T(Teacher) 
Y(Yourself)_ _ _- 


HISTORY: 
AMERICAN 


REASONS: 


S(Subject)___ __ 
T(Teacher) 
Y(Yourself)_ _ __ 


5 
12 
26 


Those who had (or 
had not) dreaded to 
start studying it: 

Not 


Dr. 
33 
7 11 
27 


Dr. 


L 
. SI 
1 

D 
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Figure II 
COLLEGE SUBJECTS 
STATUS: 


Not 


Final 
Dr. I 


Dr. L 
123 Oe 0 4 
44 21 9 6 30 15 
8 21 = (ee 


Total 175 46 111 
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Dr. 
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1 17 
1 5 


Dr. 
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0 

1 
. 
2 15 0 
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9 
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4 17 
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Not 
Dr. 
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34 


57 


Dr. 
0 , 
0 Ind. _. 
ee 
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Dr. Dr. Dr. 
10 


10 3 
6 3 6 
4 3 3 
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Dr. 


a a 
1 Ind... 10 0 
4 No... @ 5 

6 


5 Intensity 65 


Dr. 


Those who had (or 
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a studying it: 


Dr. Dr. 


r 
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3 

14 

0 

Dr. 

1 
0 


9 
9 Total 


Those who had (or 
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“— studying it: 


ot 
Dr. Dr. 
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8 
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I 
D 


STATUS: 
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Dr. 
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FIGURE II]—Continued 
COLLEGE SUBJECTS 


STATUS: DESIRE TO ELEC? 


LANGUAGES: 


REASONS: 


S(Subject) 
T (Teacher) 


Y(Yourself) _ _._ 


BIOLOGY: 


REASONS: 


S (Subject) 


T(Teacher)____- 
Y(Yourself)_ _ __ 


CHEMISTRY: 


REASONS: 


S(Subject) 


T(Teacher)____- 
Y(Yourself). _ __ 


Not 
Dr. 


L 69 
I 10 
D 2 

32 Total 81 
Those who had (or 
had not) dreaded to 

start studying it: 
Not 


Dr. 

21 
8 
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STATUS: 
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1 Dr. 
3 
2 L 44 
Dr. Dr. I 7 
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0 2 
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8 4 0 Ye. 20 3 
10 4 oo. ¥ 6 
16 0 7 No... 23 2 


29 34 11 8 10 8 Intensity 26 9 


Like, Indifference, or Dislike 


Persisting or CS Eenent Course 
From L From D 
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FIGURE II—Continued 


COLLEGE SUBJECTS 


GEOGRAPHY: STATUS: DESIRE TO ELECT 
D ee Another Course 
Cc 


Dr. Dr. L I Not 


Dr. Dr. 
6 35 US Om am’ S 
Not Yes... 15 1 


L 0 

Dr. Dr. SI 9 1 2 0 an ee (hey ee 2 
1 ; D 0 
0 


1 0 1 13 0 4 eee, 12 


28 8 
19 5 Total 45 15 25 65 13 10 Intensity 23 6 


REASONS: Those who had (or Like, Indifference, or Dislike 
had not) dreaded to — = rane; ane Course 
start studying it: From m I From 
Not Not Not Not 


Dr. Dr. Dr. Dr. Dr. Dr. Dr. 


S(Subject) 15 2 4 0 2 
T(Teacher) 4 12 1 2 0 1 
Y (Yourself) _ . .- 5 1 0 0 0 2 
Legend: > Composition (college) 
ot 
Dr. Dr. Of those students who had not dreaded to study this subject, 26 reported 
Major... 26 6 this subject as their major, 53 as their minor, and 94 as a course included in a 
Minor... 53 15 “group requirement” toward a degree earned in this university. Similarly, 
Group... 94 25 among those who had dreaded to study this subject, the numbers of stu- 
Elective. 2 0 dent reports are 6, 15, and 26 respectively. 
Semesters Not 
Among the “not dread”’ students, seven studied this subject five (or six) 
semesters, and 12, 52, and 100 studied it four, three, and one (or two) se- 
mesters respectively. Among the students who had dreaded the study of 
this subject, th the frequencies are one, five, twelve, and twenty-six res- 
pectively. 
FINAL There were 123 students who had not dread- 
ed to study this subject and who liked their be- 
I D ginning work in this study. Although 99 con- 
es. SS tinued to like to study it, 24 changed their at- 
6 30 16 6 O titude (15 becoming indifferent, an nine chang- 
oe ee ae ing to actual dislike). Among the four arcade. 
three continued to like it, one became indifferent. 
111 10 46 19 18 17 and no one chan toward dislike of this sub- 
ject. This table likewise presents the numbers of 
students (“‘not dreads” and “dreads”’): (1) who initially were indifferent toward this subject and (2) 
those who disliked it peel each is followed by the frequencies of those who persisted in or who 
their attitudes toward this subject. 
DESIRE TO ELECT Many students (94) indicated their poeegenans. These preferences follow: 
Another Course 88 “‘not dreads” and six “‘dreads”’ did desire to elect another course in this 
Not field; but 41 (36 “‘not dreads” and five “‘dreads” were indifferent, and 64 
_ oe (34 “not dreads” and 30 “‘dreads”’) preferred not to study further in this field 
Yes 88 6 That such desires were intense reactions, was indicated by 78 students (57 
Ind. 36 5 “not dreads” and 21 “‘dreads’”’). 
No 34 30 
Intensity 57 21 
REASONS: 
(1) Forty-six votes (13 “‘not dreads” and 33 “‘dreads’’) pointed to the nature of the subject matter of 
a composition as the chief cause of students who had, or who had not dreaded to start their study 
of “ae likewise 18, and 33 votes, indicated the cause as being their teacher, or themselves, res- 
pective 
(2) Sutrche students (46 “‘not dreads” and three “dreads” who liked this subject initially and who 
continued to like it (or who chan to indifference, or to dislike) attributed their attitude chiefly to the 
nature of its subjectmatter. But 28 students similarly listed the teacher and 12 ed their own abil- 
ities or inabilities as the main cause - the persistence, or change, of their attitudes throughout their study 
of this subject. Similarly, we may note the causes (S, T, Y) for persistence or change of attitude (L, I, D) 
on the part of those stu ents whose initial status had been that of indifference, or of dislike. 
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PERSISTENCE OF ATTITUDES 


Do these attitudes persist or change as the 
student progresses in a subject during a 
semester of study? Examination of Figures I 
and ITI yields facts of which the following are 
illustrative on the high school and college 
levels: 


Attitude: 
English (H.S.)_-_-- 


Chemistry (Col.)_.._____- 

Indifference 

Dislike 
On the whole, student liking of a subject 
predominated initially and persisted through- 
out the course. However, there was an accom- 
panying current of activity as students 
changed from one attitude to another. 

Comparatively, which subjects revealed 

greater persistence or change in attitudes de- 
veloped initially and during the semester? 
Comparisons of frequencies of all student 
likes with their non-likes, obtained through 
combination of the frequencies of indifference 
and of dislike, are expressed in ratios (Table 
IVb). These ratios indicate the approximate 
number of times that the frequency of 
like(L) exceeded the frequency of mon- 
~~ I plus D). These findings emerge: 


“Sealed order” in which subjects appe: 


ared: 
* gablects liked most frequently, initially and finally: 


Subjects equally often liked and non-liked, 
initially and finally: Ratios: 2:1 


Ratios: 1:1 


Subjects more Sroqneney non-liked than liked, 


initially and finally: Ratios: 
2. Comparison of “scaled orders’’: 


Subjects liked less frequently finally than initially :* = lish 


3. Order of subject fields in college compared with that in 


high school: 
Subjects liked more frequently in college: 


Subjects liked equally often in college and high 
school: tios: 2:1 and 2:1 

Subjects liked less frequently in college than in 
high school: 


‘ These lists change somewhat when we examine all sontan of six or more, in the f 
student liking from the beginning to the end of the semester on the part of each group of stu 


HIGH SCHOOL 


dreads” and “dreads”. The changes are: 


*“*Not Dreads” Added:_- 
“‘Dreads”’: Substituted:. _____- 


. Algebra 
Geometry 
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INDEPENDENCE OF ATTITUDES 


Let us examine another approach to this 
question of possible association between these 
two factors. In general, are the student atti- 
tudes of not dreading or dreading a given 
course independent of their liking or non- 
liking that course? Or, is there a positive 

Changed 
From L 


15 
11 


10 
7 
10 
relationship between these attitudes? A tech- 
nique for studying this question is described 
by Fisher.® Collecting all frequencies in the 
two classifications of “not-dreads and dreads” 
and of “like and non-like” from the end 
status data for any one subject, e.g., geom- 
etry from Figure I, we have the following 
2 x 2, or fourfold table: 
Dr. Totals 
17 100 
48 88 


65 188 


SR. A. Fisher, Statistical Methods for Research Workers, 
pp. 88-95. Edinburgh and London: Oliver and Boyd, (Sev- 
enth Edition), 1938. 





COLLEGE 
—— me 
oreign languages 
yo me iktery 


HIGH SCHOOL 
English 
Biology 
American history 
World history 
Algebra 
General science 
Geometry English composition 
i Biology 
Chemistry 


English literature 
Foreign languages 
Geography 


FINALLY 
Foreign languages 


iology 
Foreign languages 


INITIALLY 
English literature 
Foreign languages 


jon history 
Biclony composition 


American history 
English composition 
Biology 

uencies of 
ents, “not 


COLLEGE 
Biology, English composition 


History (American and World) Biology, English composition 
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Applying the formula for Chi square* to 
this fourfold table, we have: 


xe (83:48 — 17°40)* - 188 
100°88 - 123-65 


Since the “number of degrees of freedom” 
is one, this value of X* (29.17) corresponds 
to the probability’ that P>.o1. Thus, dread- 
ing or not dreading to study geometry and 
liking or non-liking it by the end of the 
semester are clearly not independent atti- 
tudes. In other words, it does make a differ- 
ence whether a pupil does or does not dread 
geometry before he starts to study it. 

Values of X* with the corresponding values 
of the probability (P) for each subject on 
the high school and college levels are stated 
in Tables Va and Vb. The fourfold tables 
pertaining to high school chemistry, college 
chemistry, and geography do not indicate 
that we can reject the hypothesis of independ- 
ence between the factors of dreading(or not) 
and later liking(or not) these subjects. In all 
other subjects, including eight on the high 
school level and five on the college level, we 
have found a significant difference between 
these student attitudes, that of dreading(or 
not) and their later liking(or not) the subject 
studied. The value of X*, however, does “not 
measure the degree of association” between 
these attitudes;* to measure the latter, it 
would be necessary to inquire beyond the 
data available in this study.’ 





= 29.1701 


CAUSES OF PERSISTENCE OF ATTITUDES 


Various reasons*® for development and per- 
sistence or change of student attitudes of like, 
or indifference, or of dislike of these school 
subjects indicate that, as indicated in Figures 
I and II: 

1. Unlike the reasons for dreading cr not 
dreading a subject preceding their study of 
it, students in high school and college agree 
not only that the most potent cause for liking 
a subject and for such liking to persist, or in 
a few cases to change to indifference or to 
dislike, is the nature of the subject itself; but 

* Ibid., p. 90. 

* Ibid., Table of X*, pp. 118-19. 

8 Ibid., p. 94. 

_*If, eg., we could assume that amounts of dread, and 
similarly of liking of a given subject are distributed according 
to a normal distribution, tetrachoric r’s could reveal the 
degree of association between these factors. But the data 
presented in Figures I and II would not warrant our accept- 
ance of this assumption. 


These are subject to the limitations described under the 
examination of reasons for dreading a school subject. 
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their statements likewise point, though to a 
much lesser degree, to the teacher as the more 
potent contributing cause than is their esti- 
mate of their own ability to master the subject 
matter, the pattern being S>T>Y. 

2. When student reaction is indifference, 
whether such persists or changes to like or 
dislike of a subject, the contributing factors 
for high school pupils agree mainly with those 
reported under their liking of a subject, 
although the number of cases and the differ- 
ences between the reported causes are much 
smaller. College students, however, who had 
not dreaded their approaching study of a sub- 
ject, while agreeing in American history, re- 
port that their indifferent attitudes toward 
chemistry and English composition are due 
mainly to the teacher and only in decreased 
emphasis to the nature of the subject and 
estimates of their own abilities, (T>S2Y). 
The latter reflects their attitude toward all 
other subjects except one, namely, that those 
who had dreaded chemistry regard the 
teacher as the least, and the nature of the 
subject and their own ability as the equally 
greater contributing causes. 

3. High school pupils regard the teacher 
as the most important reason for their dislike 
of English and of American and world history, 
but for all other subjects they name the 
nature of the subject matter; the number of 
cases, however, is small. For college students, 
the nature of the subject matter and the 
teacher are stated most frequently as the 
contributing causal factors (S2T>Y), with 
the exception of chemistry, in which they rate 
their own ability or inability as a more 
potent factor than the teacher. (S>Y>T). 

In summary, the reaction of high school 
and college students toward the factors con- 
tributing to the development of their atti- 
tudes is in general found to be, in decreasing 
order: the nature of the subject matter, the 
teacher, and their estimates of their own 
ability to master this subject matter. 


MOTIVATING PowER oF SCHOOL SUBJECTS 


To what extent did study of these school 
subjects arouse the pupils’ desires to elect 
another course(s) in the same subject field? 
From examination of Figure III, we may 
draw the following conclusions: 

All students —If left to their own desires, 
students while in high school would wish to 
select a further course in English. This is 
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true, likewise, for college students of English 
literature. In high school some students 
would not wish to elect courses in algebra, 
foreign languages, or chemistry, and their 
opposition toward further study of geometry 
becomes much more frequent and definite. 
The latter similarly is descriptive of their 
reaction toward the college subjects of chem- 
istry, biology, and geography. 
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“Not-dreads” —The reaction on the part of 
those students who had not dreaded the study 
of these subjects parallels the above findings 
quite closely, but with these exceptions: (1) 
the more specific opposition of the students 
toward additional courses in high school 
chemistry and algebra, and (2) a somewhat 
more favorable attitude toward each subject 
on the college level. 


Figure III 


COMPARISON (EXPRESSED IN RATIOS)™ BETWEEN NUMBERS OF STUDENTS WHOSE DESIRES WOULD, 
or WOULD Not, Direct THEM TOWARD FURTHER STUDY IN THESE SUBJECTS 


All Students 


HIGH SCHOOL 
SUBJECTS 
3. 


2. English 


Biol. 


. Am. Hist., World Hist., Gen. Sci., 
. Alg., For. ‘Langu Chem. 


. Geometry 


ages, 


STUDENTS NOT DREADING 
STUDENTS DREADING*® 


2. English 
. Am. History 


— 


m., 


(English, Biology) 


(Am. History, C istry) 


(Gen. Science) 
(Algebra) 
(World History, For. Langs.) 


>. F. 2. 2... Oe, 


. (Geometry) 


— 
= 


14. 


Biol. 
World Hist, For. Langs., Gen. Sci., 
Alg., hem. 


COLLEGE 
SUBJECTS 


3. 
. Eng. Lit. 


2 
1. Eng. Comp., Am. Hist., For. Languages 
2. Chemistry 
. Biology 
3. Geography 
THESE SUBJECTS 
3. Eng. Lit. 
2. 
. Eng. Comp., Am. Hist., For. Langs. 
Chemistry 
Biology , 
Geography (Am. History) 


= 


(Chemistry) 
(Eng. Lit.) 
. (Eng. Comp., For. Langs.) 


(Biology) 


°°. 3%. 9.97. -. ©, § 


— 
>. 


14. (Geography) 


11 These ratios, found in Table V, have been expressed to the nearest integer. 


nd: H.S. ‘subjects for all students 


English is the only subject in which the greater number of pupils have indicated their wish to study 
another course in the same subject. Their desire is expressed by the ratio of nearly 2:1 

American history, world history, general science, and biology have ap pproximatel equal numbers of 
pupils who do and who do not wish to study these subjects further (ratios of nearly 1:1 if 

the contrary, foreign languages, chemistry, and biology in a ratio of about 1.5:1, and geomet with 

a ratio of 2.5:1, are the subjects in which the greater number of pupils have stated ‘their opposition to- 
ward stud dying further i in these fields. 

12 “Students dreading” in parentheses. 
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“Dreads”.—The most unanimous results, 
however, were the statements of those stu- 
dents who had dreaded to begin their study 
of these subjects. Each subject revealed the 
greater numbers of students stating their in- 


TABLES JA, IB, Ic, ID—STUDENT PERSONNEL 
TABLE IA 
CLASSIFICATION OF STUDENTS 


(A)* (B)* Total 

13 20 

82 117 

Sophomores - 2 71 
Freshmen -.- - 0 14 
Special 2 3 
99 225 


¥ (A) and (B) are frequencies of students of edu- 
cational psychol and of high school methods, 
ively. This footnote applies to Tables La, 


respecti 
Is, Ic, an Ip. 
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difference or opposition toward election of 
courses in these subject fields. 

The intensity of their desire to elect or not 
to elect courses in these fields was indicated 
by smaller numbers of students and with dif- 
fering proportions of “not-dreads”(36%- 
55%) and of “dreads”(23%-—100%). Com- 
paratively, in seven high school and three 
college subjects, the “dreads” described their 
desire as being strong to elect or not to elect 
courses in these fields in greater numbers, 
expressed in percentages, than did the “not- 
dreads”. 


CONCLUSIONS AND RECOMMENDATIONS 


Significant for teacher guidance of learners 
in various subject areas are the findings: 
(1) that the development and persistence or 
change of attitudes accompanying achieve- 
ment in these areas are in part dependent 


TABLE IB 
STUDENT RATINGS OF THEIR ACHIEVEMENT LEVELS 


IN HIGH SCHOOL 
(A) (B) Total 
58 123 


% 


56 
36 92 42 
2 


3 5 





97 220 


TABLE Ic 
Size or HicgH ScHooL ATTENDED 


School (A) (B) Total 
city... 38 30 68 
i 28 21 49 
46 99 
1 7 
0 1 


98 224 





Ps ook BSa 


TABLE ID 


RaTinGs on A. C. E. PSYCHOLOGICAL 
EXAMINATION 


(For College Freshmen) 


% 
11 
31 
33 
24 


99 


4 Scaled values of 1 to 9 are the means used to 
jhterpret the raw scores earned on this test. 





IN COLLEGE 
(A) (B T 


7 
58 
32 

0 


97 





upon their earlier attitudes of dread or not- 
dread of experiences which these subject areas 
imply ; and (2) that election of courses like- 
wise is influenced by the fact of dread or not- 
dread of these subjects preceding study in 
these areas. Although these findings are lim- 
ited by the relative amounts of the frequen- 
cies, for those of “dreads” are much smaller 
than those of “not-dreads’’, they reveal trends 
that are consistent and should be directive 
toward techniques which will guide pupils in 
their initial learnings in a given field. Hence 
the following recommendations are in order. 


SUGGESTIONS TO TEACHERS 


1. Teachers of algebra and geometry.— 
Whereas “dreads” regard their own ability or 
inability as contributing causally to their 
difficulties in achieving satisfactorily in these 
subjects, and whereas “not-dreads” regard 
the teacher’s guidance as the more important 
contributing factor, it is recommended that 
all “dreads” be discovered by the close of the 
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TABLE II 
FREQUENCIES OF STUDENTS WHO HAD, orn Hap Not, Dreapep: (N=225) 
HIGH SCHOOL SUBJECTS 


% % % 
REPORTING NOT DREADS DREADS 


Foreign 1 , 
oreign languages_--_- - __- 
Chemistry 

eae 


COLLEGE SUBJECTS 


% % % 
SUBJECT REPORTING NOTDREADS DREADS 
English literature____ 
English composition 
— history 
oreign languages _ _ _ - - 
Geography 7 


TABLE III 
NUMBERS OF STUDENTS RESPONDING TO QUESTIONS CONCERNING THE SUBJECTS 
STATUS DESIRE TO ELECT INTENSITY 
SUBJECTS Initial Final COURSE IN OF 
HIGH SCHOOL L, I, D L, I, D SAME SUBJECT THIS DESIRE 
(N) NotDr. Dr. (N) NotDr. Dr. (N) NotDr. Dr. 
209 ( 194, 15 ) 204 ( 194, 10 ( 8 


196 ( 160, 186 ( 1651, 35 ( 17 
150 ( 128, 151 ( 129, 22 ( 


200 ( 197 155, 42 
188 ( 187 ( 124, 
193 190 ( 146, 44 


113 114 101, 
96 97 86, 
62 63 44, 
20 18, ) 20 18, 
COLLEGE 
English: 
omposition...... 221 ( 175, 199 158, 
Literature____- 3" 117, 7 125 6 71 


History: 
American - 84 65, 19 ) 81 ( @, 19 42 
35 31, ae 14 13, 


Mathematics" ___ 36 32, 4 

Languages. ____- ; 81, 26 110 82, 28 56 40, 

Science: 
Biology. _ - --_- : 82 53, ea 60, 29 35 ( 26, 
Chemistry 29, 36 ) 65 31, 34 27 ( 18, 
Geography - ___- 45, 15 ) 60 45, 15 29 ( 28, 


— (English) 

4% The number of students (209) who indicated their liking (or indifference or dislike) of English during 
the earlier and latter parts of the semester of study included those (194) who had not dreaded and those 
(15) who had dreaded to study this subject. 

Among those (204) who stated their desire to elect or not to elect another course in English, there were 
194 students who had not and 10 who had dreaded to study English. The intensity of their desire was 
reported by 98 students, of whom there were 90 who had not, and eight who had, dreaded to study the 
subject. 

6 Subject was not included in this study, owing to its small frequency of cases. 
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TABLE IVA 


RATIOS” OF FREQUENCIES OF STUDENT LIKE(L), INDIFFERENCE (I), OR DiIsLIKE (D) of 
SuBJEcTs: (FINAL STATUS) 


HIGH SCHOOL SUBJECTS 


RATIOS 
SUBJECT D 
English" _ _. 
American history - 


World history _ - 
Algebra 
Not dreads. - 
Dreads___- 


Foreign languages ara 
Not dreads _ sca 

General science aR 

Biology 

Chemistry - - 


Cron he™ ™ DO & DODO m DO OT Ry 
Dee eh et i ek et ED et et et et et et et et st 


COLLEGE SUBJECTS 
RATIOS 
L 


0 


SUBJECT 
English composition 
ot dreads 
Dreads 
English literature 
American history 
Foreign languages _- _- 


ao 


Biology - - - __-- 
Not dreads. 
Dreads___- 

Chemistry _- 
Not dreads 
Dreads__- 

Geography - 


Pome et END et et ee ee ee ee DO DO CODD 
4+ 


Dee et OO De DO 


” Ratios are expressed, to the nearest integer, in percentages. Frequencies pertain: (i) to all students; 
(ii) to ‘not dreads” and “dreads” when the minimum frequency of “‘dreads”’ is 25. / indicates the fre- 
quency, other than that of dislike, upon which the computations were based. 


18 Legend: English (high school) 


Since the frequencies of L, I, D are 160, 41, and 8 respectively, there are, among all the students re- 
sponding to the questionnaire in high school English, approximately 20 times as many “likes” as “‘dis- 
likes” and 5 times as many “‘indifferents”’ as “dislikes”’. 


TABLE IVB 


RATIOS” OF FREQUENCIES OF STUDENT LIKE (L) 
AND Non-LIKE (I+D) 


(Initial and Final Status) 
HIGH SCHOOL SUBJECTS 
SUBJECT (N) 


STATUS 
INITIAL FINAL 
4:1 


71 
71 
71 
il 
1 
4 | 
1 
1 


American history 
World history 


Foreign languages - - - - 
General science 
Biology 

Chemistry 


monnr™ rrr 
DO Do 19 DO DD Co 
fame ant fk fk fat ek fk pt 


COLLEGE SUBJECTS 


SUBJECT (N) STATUS 
INITIAL FINAL 
English composition _. 221 1:1 : 
English literature 124 : : 
American history - - - - 84 
Foreign languages.... 107 
iol 82 
65 : 
Reversed (NonL 
62 2:1 
” Ratios are expressed, to the nearest in r, in 
percentages. Frequencies for both initial and final 
status refer to the total number of students par- 
ticipating. 


- L) 
1:1 


semester preceding their study of these sub- 
jects, and that instruction be patterned to 
decrease their difficulties and to guide them 
toward their most efficient mastery of these 
subjects. 


2. Teachers of all subjects—(a) Despite 
the relatively small number of “dreads” in 
certain subjects and the heavy preponderance 
of like versus indifference or dislike of sub- 
jects, procedures as suggested above would 
tend to reduce the negative and withdrawing 
attitudes of the “dreads”, possibly to the ex- 
tent of converting “dreads” into active, 
understanding, and eager searchers into the 
experiences thus opened to them, not only in 
this subject but in the more advanced and 
related subject areas. 


(b) Whereas those who were indifferent to 
or disliked the subject tended to indicate the 
teacher as a contributing factor of greater 
significance than is their own ability or in- 
ability, and whereas those who liked the sub- 
jects regarded the nature of the subject as 
the factor of greatest influence, it would be 
helpful if teachers of these subjects would 
challenge their methods of teaching in the 
light of these findings. Whether the subject 
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be English, history, foreign languages, mathe- 
matics, or science on the high school or col- 
lege level, it would seem wise for teachers of 
these subjects to analyze their techniques 
critically. It is suggested that they attack 
this problem by asking themselves such ques- 
tions as: (1) Am I presenting these subject 
areas in logical ways? Or, am I guiding 
pupils in building more efficient habits of per- 
ceiving the data of a given problem precisely 
and comprehensively, of recalling facts perti- 
nent to this problem, and especially of react- 
ing toward it purposively? (2) Thus, have I 
directed their building of an hypothesis con- 
cerning the solution of this problem, and their 
testing of this hypothesis? (3) If the hypoth- 
esis does not work, do my pupils know what 
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to do next, especially where to “begin again” 
in order to develop a second hypothesis and 
as many more “trial guesses” as prove to be 
necessary before the solution is found? (4) 
Will my pupils generalize this solution, and 
therefore increase the probability that they 
will recognize its reappearance as a factor in 
a similar situation and be able to act appro- 
priately toward that situation? 

Such constructive changes can become in- 
creasingly educative both for teachers who 
review and in part rebuild their methods of 
approach, of presentation, and of guidance of 
pupil activities, and also for pupils who can 
now approach initial learnings eagerly with 
increasing assurance that successes, not 
errors, are for them becoming realities. 


TABLE VA™ 
VALUEs or X*, WITH CORRESPONDING PROBABILITY (P) 


HIGH SCHOOL 


Foreign languages _ 
iaotien oo... 


_.17. 2812 
13. 5108 
_ 9. 7847 


\ ae = ne. sana 
English 
General science 


SS a tine hoe 


. 0.3321 


COLLEGE 


English composition - 


Foreign languages - - - - 


American history 
English literature 


60_- 
— 


TABLE VB” 
(Based upon Table Va) 


SUBJECTS IN: n 
Part 1 1 
Part 2 1 
Part 3 1 


5. 2039 
0. 3821—2. 9988 
or (.10—. 70) 


* Tables Va and Vb: See the text of this article for the meaning and use of these tables. 


Meaning of: 


(N) is the number of students responding to a subject questionnaire. 
“n” is ~ 2 gael of degrees of freedom” in the 2 by 2, or fourfold table, upon which the computa- 


due wane bs 


X?: The table of X? is presented in the text: R. A. Fisher, Statistical Methods for Research Workers, 


pp. 118-19. 
P (Probability): ibid., pp. 82, 83. 
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TABLE VI" 
STUDENT DEstRE TOWARD FURTHER STUDY IN THESE SUBJECT AREAS 


ALL STUDENTS 
HIGH SCHOOL COLLEGE 
Subject tios Subject Ratios 
Y>N Y=N N>Y Y>N YeN N>Y 
English alias English composition -- Las 
American history” _ _ _ _ - _- 1.0 English literature 2.6 
World history_........-.-- 1.1 American history - - _ - - i 
CE ‘ Foreign languages - - - - & 
Tt itintbecssccces q 
Foreign languages _ ------- 
General science a .15 
i ctbwenasanccss0- 1.0 
Chemistry ----- - - - : 1.6 
STUDENTS NOT DREADING { THESE SUBJECTS 
STUDENTS DREADING* 


HIGH SCHOOL COLLEGE 
Subject Ratios Subject 
Y>N Y=N N>Y 


English : (2.3) English composition 
American history _-- - - - ; (2.9) English literature 


World history 1.15 (6. 3) 
1.9 (6.0) 


1.6 (9.5) 
Foreign languages 1.0 (6.3) 
General science 1.0 (5. 5) 
Biology 1.15 (2. 7) 


—ORO- OOO 
ee ee ee ee ee ee 


Chemistry... ..._.... 1.3 (2.8) 
21 wee in ratios of frequencies of those who: 


Y) wish to elect the subject, 
(N) wish not to elect subject. 

® Legend: (American history) 

Among all of the pupils res — ; to this question concerning the study of American history in high 
school, there are approximately equal numbers of pupils who do and who do not wish to study this subject 
further. Their desire is expressed by the ratio of 1:1. 

Among those pupils who had not dreaded their study of this subject, the larger number of pupils have 
indicated their desire a oeery by the ratio of 1.3:1) to study another course in the same subject. 

Among those pupils who had dreaded their study of this subject, the greater number of pupils indicated 
their opposition (revealed by the ratio of 2.9:1) toward further study in this field. 

*% “Students dreading” in parentheses. 
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